Skip to content

From NVIDIA Megatron-LM for visibility#18

Open
RaymondLi0 wants to merge 6488 commits intobigcode-project:multi-query-attentionfrom
NVIDIA:main
Open

From NVIDIA Megatron-LM for visibility#18
RaymondLi0 wants to merge 6488 commits intobigcode-project:multi-query-attentionfrom
NVIDIA:main

Conversation

@RaymondLi0
Copy link
Collaborator

@RaymondLi0 RaymondLi0 commented Jan 24, 2023

No description provided.

@RaymondLi0 RaymondLi0 changed the base branch from multi-query-attention to before-merge June 20, 2023 20:12
@RaymondLi0 RaymondLi0 changed the base branch from before-merge to multi-query-attention June 20, 2023 20:12
chtruong814 and others added 28 commits February 9, 2026 18:30
@chtruong814
ci: Revert "ci: Add secrets detector (#3180)" (#3330)
8d79987 
Signed-off-by: Charlie Truong <[email protected]>
@ko3n1g
ci: Add more tests, run on merge-queue (#3317)
55c3e63 
Signed-off-by: oliver könig <[email protected]>
@chtruong814
ci: Remove merge-gate environment check (#3331)
ba76934 
Signed-off-by: Charlie Truong <[email protected]>
@kwyss-nvidia @yaox12 @ericharper
Use FP4 context for mamba (#2604)
ab5e277 
Co-authored-by: Xin Yao <[email protected]>
Co-authored-by: Eric Harper <[email protected]>
@chtruong814
ci: Ensure we run all functional tests in merge group (#3332)
fc557ec 
Signed-off-by: Charlie Truong <[email protected]>
@nschank
Replace ModuleSpec with Protocols for inputs to MLP (#3084)
55198ba
@chtruong814
ci: Fix merge queue functional tests (#3337)
5eb20b8 
Signed-off-by: Charlie Truong <[email protected]>
@ko3n1g
ci: skip queue in merge-gate (#3343)
367f0b8 
Signed-off-by: oliver könig <[email protected]>
@ko3n1g
ci: Timeout for functional tests (#3346)
3fb6006 
Signed-off-by: oliver könig <[email protected]>
@dimapihtar
update checkpointing documentation (#3347)
76cf11e 
Signed-off-by: dimapihtar <[email protected]>
@tdene
Update golden values to reflect improvements (#3350)
836d473
@sancha @BestJuly
BUGFIX: gpt vs hybrid model mtp naming mismatch (#3334)
2451508 
Co-authored-by: Li Tao <[email protected]>
@tdene
Disable flaky test (#3354)
8da949e
@jon-barker
re-enable gpt grpo tests (#3348)
bb97791
@asolergi-nv
Fix SFT Pipeline when TP>1 (#3268)
4bce841
@AAnoosheh
Fixes for KD mode (#3342)
f5238ba 
Signed-off-by: Asha Anoosheh <[email protected]>
@github-actions
chore: rotate oncall schedule
c1169ea
@ko3n1g
chore: Update codeowners file (#3365)
4f025a1 
Signed-off-by: oliver könig <[email protected]>
@sidsingh-nvidia @ko3n1g
Siddharth/fix inference functional tests (#3357)
66ec17e 
Co-authored-by: oliver könig <[email protected]>
@janEbert @ko3n1g
Switch oncall (#3360)
6a9da99 
Co-authored-by: oliver könig <[email protected]>
@AAnoosheh
Add missing RMSNorm to llama train script (#3314)
b6e883b 
Signed-off-by: Asha Anoosheh <[email protected]>
@tdene
Fix inference for MTP models (#3297)
cd14090
@yobibyte
Add a logprobs test with real gpt model. (#2870)
6f5de16
@tdene
Add simple GRPO functional test (#3323)
b5d50cb
@ko3n1g
ci: Concurrency control for merge-queue (#3353)
1c245c7 
Signed-off-by: oliver könig <[email protected]>
@chtruong814
ci: Update golden value download script to work with Github (#3335)
d9f075c 
Signed-off-by: Charlie Truong <[email protected]>
@megnvidia
Removing etc from main index page, shifted name of discussions (#3271)
d0b768f 
Signed-off-by: meg miranda <[email protected]>
@thecaptain789 @Phlip79
fix: correct typos 'seperated' and 'recieved' (#3305)
7d1acf6 
Co-authored-by: thecaptain789 <[email protected]>
Co-authored-by: Philip Petrakian <[email protected]>
leisuzz and others added 30 commits March 9, 2026 01:36
@leisuzz @Phlip79
[bugfix] fix the bug that loss: 0 will not be printed (#1555)
b09ee64 
Co-authored-by: Philip Petrakian <[email protected]>
@CarlosGomes98 @ericharper
@claude @Phlip79
Fused dLN + add in backwards pass (#3384)
8318b80 
Co-authored-by: Eric Harper <[email protected]>
Co-authored-by: claude[bot] <209825114+claude[bot]@users.noreply.github.com>
Co-authored-by: Philip Petrakian <[email protected]>
@github-actions
chore(beep boop 🤖): Bump (main) (2026-03-09)
597721a
@Phlip79
Claude: run actions on target branch (#3745)
116a7fa
@dimapihtar
revert of #2658 (#3736)
56158bb 
Signed-off-by: dimapihtar <[email protected]>
@ilml @ericharper
Update README Quick Start (#3596)
452fc11 
Co-authored-by: Eric Harper <[email protected]>
@mathemakitten
Re-enable tests which were failing on #3373 (#3757)
d904a68
@Phlip79
Check reviews properly (#3756)
94ff0dc
@github-actions
Update copy-pr-bot.yaml [skip ci]
ce66b22
@mehraakash
Add CP + Sequence Packing support for Mimo (#2135)
0e19bf1
@wdykas @mathemakitten
@ahmadki @cursoragent
MXFP8 refit (#3742)
fca1679 
Signed-off-by: Ahmad Kiswani <[email protected]>
Co-authored-by: Helen Ngo <[email protected]>
Co-authored-by: Shanmugam Ramasamy <[email protected]>
Co-authored-by: Ahmad Kiswani <[email protected]>
Co-authored-by: Cursor <[email protected]>
Co-authored-by: William Dykas <[email protected]>
Co-authored-by: root <[email protected]>
@Phlip79
Claude: update token usage (#3760)
397772e
@sancha
Handle Tool Call Argument Parsing (#3662)
3eea580
@jon-barker
RL support for nanov3 sft checkpoint (#3741)
e970199 
Co-authored-by: Jon Barker <[email protected]>
@yeyu-nvidia
add mix_hidden_states option in conversion (#3655)
ba497c9
@ko3n1g
ci: Optimize release-configs for GB200 (#3541)
22c69fa 
Signed-off-by: oliver könig <[email protected]>
@github-actions
Update copy-pr-bot.yaml [skip ci]
0f47a1a
@kunlunl
Add absorbed-mla (#3198)
204e7d5
@Victarry @claude
feat(checkpoint): zero-copy storage sharing in CheckpointWithoutOutput (
f544034 
#3649)

Co-authored-by: Claude Opus 4.6 (1M context) <[email protected]>
@cjld @yaox12
Fuse MLA DOWN projection GEMMs (#3039)
8fd390d 
Signed-off-by: Xin Yao <[email protected]>
Co-authored-by: Xin Yao <[email protected]>
@Victarry @claude
fix: skip FSDP DTensor boundary validation under fake process group (#…
7d52694 
…3686)

Co-authored-by: Claude Opus 4.6 (1M context) <[email protected]>
@yuzhongw-nvidia
[main] fix(moe): fix the bug where gate was not sliced when kv_head <…
16a8cdb 
… tp_size. (#3575)

Co-authored-by: xiaotaoliu <[email protected]>
@rapatel @lhb8125
fix(offload): reset activation offload manager after eval as well as … (
b8e23d5 
#3739)

Co-authored-by: Hongbin Liu <[email protected]>
@github-actions
chore: rotate oncall schedule
07e512a
@yobibyte
Improve error logging when invalid number of tokens is requested. (#3680
e20b89a 
)
@jenchen13
Add NVIDIA-Nemotron-3-Super-120B-A12B-BF16 to ModelOpt examples (#3805)
5bc89f3
@ko3n1g
build: Bump TE2.13 (#3800)
da46946 
Signed-off-by: oliver könig <[email protected]>
@jalbericiola @mathemakitten
Ensure dummy_forward does not attempt to run cudagraphs (#3789)
8e64e69 
Co-authored-by: mathemakitten <[email protected]>
Co-authored-by: Helen Ngo <[email protected]>
@santhnm2 @shanmugamr1992
Add speculative decoding support with MTP layers (#3594)
8f539df 
Signed-off-by: Keshav Santhanam <[email protected]>
Co-authored-by: Shanmugam Ramasamy <[email protected]>
Co-authored-by: shanmugamr1992 <[email protected]>
@shanmugamr1992 @tdene
@ArEsKay3 @i-riyad
Shanmugamr1992/megatron inference ultra (#3784)
39472d8 
Co-authored-by: Teodor-Dumitru Ene <[email protected]>
Co-authored-by: Robert Kirby <[email protected]>
Co-authored-by: Shanmugam Ramasamy <[email protected]>
Co-authored-by: rislam <[email protected]>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.