Articles tagged #torchtitan

2 articles found

Tech News • 2 weeks ago

PyTorch and Nebius achieved up to 41% faster DeepSeek-V3 MoE pre-training on 256-GPU NVIDIA B200 clu...

Tech News • 3 weeks ago

Achieve a +30.2% training speedup for Llama4 Scout with MXFP8 MoE training using TorchAO and TorchTi...