Skip to content

Pull requests: NVIDIA/Megatron-LM

New pull request New
118 Open 414 Closed
118 Open 414 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

fix several typos in megatron/core/transformer/multi_token_prediction.py
#1744 opened Aug 13, 2025 by andy-yangz Loading…
Hongbinl/1f1b overlap mirror 0813
#1743 opened Aug 13, 2025 by lhb8125 Loading…
ci: Add build-test-publish wheel workflow
#1742 opened Aug 13, 2025 by ko3n1g Loading…
Megatron Bridge Adaption
#1741 opened Aug 12, 2025 by yaoyu-33 Loading…
Add world_size dict getter method for simple integration with W&B enhancement New feature or request
#1735 opened Aug 9, 2025 by WoosungMyung Loading…
export _move_new_state_to_right_device for offload/load enhancement New feature or request
#1734 opened Aug 8, 2025 by techkang Loading…
Megatron-LM changes to make Hyena/Evo 2 inference usable, especially for 40B models enhancement New feature or request
#1727 opened Aug 1, 2025 by antonvnv Loading…
fix router input jitter dtype bug Something isn't working
#1726 opened Aug 1, 2025 by chaitanyadwivedi96 Loading…
Add FP8 training scripts enhancement New feature or request module: transformer engine
#1723 opened Jul 31, 2025 by SDcodehub • Draft
Typo correction module: documentation
#1717 opened Jul 29, 2025 by Aditya-Shandilya1182 Loading…
docs: improve code comments module: documentation
#1712 opened Jul 26, 2025 by lorinlee Loading…
@sbhavani
1
Fix a typo on README git checkout module: documentation
#1705 opened Jul 24, 2025 by GindaChen Loading…
BugFix: FP8 Communication Mismatch with --first-last-layers-bf16 in tp-comm-overlap bug Something isn't working module: transformer engine
#1703 opened Jul 24, 2025 by xiaomin-D Loading…
2
Add Support for Packed Sequence Format in GPT Training module: training
#1696 opened Jul 17, 2025 by sbhavani • Draft
Align import to existing module module: data pipeline
#1692 opened Jul 15, 2025 by AlexanderLavelle Loading…
fix(mtp logging): Correctly accumulate MTP loss for logging when log_interval > 1 module: moe
#1684 opened Jul 11, 2025 by Luowaterbi Loading…
1
Update pretrain_mamba.py bug Something isn't working module: documentation
#1682 opened Jul 11, 2025 by vignesh1507 Loading…
[feat, moe] Add support for global aux loss module: moe
#1681 opened Jul 11, 2025 by Victarry Loading…
2
Issue 1672 fix: initializing the current pointed with int64 to avoid … bug Something isn't working community-request
#1673 opened Jul 7, 2025 by sharanmayank Loading…
2
Support 1f1b a2a overlap module: distributed
#1671 opened Jul 7, 2025 by lhb8125 Loading…
1
moe: remove unused variable scale_up module: moe
#1670 opened Jul 6, 2025 by WineChord Loading…
Speed up model parallel initialization module: distributed
#1662 opened Jul 2, 2025 by alexqdh Loading…
Update README.md module: documentation
#1660 opened Jul 2, 2025 by 21jun Loading…
1
bug fixed: wandb artifact requires the tracker file module: debugging
#1654 opened Jun 27, 2025 by yezhengmao1 Loading…
Apply roll operation to position_ids in MTP module: moe
#1651 opened Jun 26, 2025 by iansheng Loading…
@iansheng @BoxiangW
ProTip! Follow long discussions with comments:>50.