Search results

[BUG]Load DCP OOM

Status: Open.

#1746 In NVIDIA/Megatron-LM;

· zjjott opened on Aug 14, 2025

[QUESTION] In MoE, how is the correctness of Sinkhorn guaranteed when enabling sequence parallelism?

questionFurther information is requestedFurther information is requested

Status: Open.

#1740 In NVIDIA/Megatron-LM;

· IamArabbit opened on Aug 12, 2025

gpt-oss implementation

enhancementNew feature or requestNew feature or request

Status: Open.

#1739 In NVIDIA/Megatron-LM;

· sbhavani opened on Aug 11, 2025

[ENHANCEMENT] Support for FusedLinearCrossEntropy Loss for memory savings

enhancementNew feature or requestNew feature or request

module: transformer engine

Status: Open.

#1738 In NVIDIA/Megatron-LM;

· Skylion007 opened on Aug 11, 2025

[QUESTION]Loss Differences Between Single GPU and Tensor Parallelism

questionFurther information is requestedFurther information is requested

Status: Open.

#1736 In NVIDIA/Megatron-LM;

· Tona8941 opened on Aug 10, 2025

[QUESTION] Is there a way for Megatron to recompute the whole transformer layer except for the flash-attn part?

module: transformer engine

questionFurther information is requestedFurther information is requested

Status: Open.

#1732 In NVIDIA/Megatron-LM;

· xUhEngwAng opened on Aug 6, 2025

[QUESTION] why is optimizer state all in CPU memory in my runs?

questionFurther information is requestedFurther information is requested

Status: Open.

#1730 In NVIDIA/Megatron-LM;

· husam-e opened on Aug 4, 2025

[ROADMAP] Megatron Core MoE Q3-Q4 2025 Roadmap

call for contribution

module: moe

Status: Open.

#1729 In NVIDIA/Megatron-LM;

· yanring opened on Aug 4, 2025

[QUESTION]：moe a2a overlap

questionFurther information is requestedFurther information is requested

Status: Open.

#1728 In NVIDIA/Megatron-LM;

· qiunvlalala opened on Aug 3, 2025

[BUG] Inaccurate FLOPs Calculation for Models with Specialized Attention

bugSomething isn't workingSomething isn't working

Status: Open.

#1725 In NVIDIA/Megatron-LM;

· NuojCheng opened on Aug 1, 2025

[QUESTION]Why are inputs to ColumnParallelLinear different across ranks in register_forward_hook and register_forward_pre_hook

questionFurther information is requestedFurther information is requested

Status: Open.

#1722 In NVIDIA/Megatron-LM;

· UnbearableFate opened on Jul 31, 2025

Benchmarking DeepEP Guide

module: documentation

module: moe

Status: Open.

#1721 In NVIDIA/Megatron-LM;

· sbhavani opened on Jul 31, 2025