Skip to content

Pull requests: pytorch/torchtitan

New pull request New
422 Open 2,874 Closed
422 Open 2,874 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Fix varlen attention metadata under pipeline parallelism ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#4098 opened Aug 10, 2026 by VFYAS Loading…
3
[MoE] Apply router scores before W2 projection ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#4095 opened Aug 9, 2026 by Mystri Contributor • Draft
4 tasks
1
Fix padded image patch budget ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#4094 opened Aug 9, 2026 by aswanth-07 • Draft
1
1
[wip] spmd_types simpleFSDP ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#4091 opened Aug 7, 2026 by pianpwk Contributor • Draft
Support tensor parallelism with MinimalAsyncEP ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#4089 opened Aug 7, 2026 by wwwjn Contributor • 2/2 Loading…
3
[Grain] Replace dataset/dataloader with grain ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#4088 opened Aug 7, 2026 by felipemello1 Contributor Loading…
19
[notforeview(yet)][spmd_types] try spmd_types as default backend ciflow/rl ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#4085 opened Aug 7, 2026 by pianpwk Contributor • Draft
[rl] Add a standalone weight-sync transport benchmark ciflow/rl ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#4083 opened Aug 7, 2026 by JenniferWang Contributor • 3/3 • Draft
[rl] Add weight-sync transport dial and a manual CPU-staging escape hatch ciflow/rl ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#4082 opened Aug 7, 2026 by JenniferWang Contributor • 2/3 • Draft
Use DTensor placements for distributed metrics ciflow/rl ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#4081 opened Aug 7, 2026 by pianpwk Contributor • Draft
1
inference moe expert sp padding ciflow/rl ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#4080 opened Aug 7, 2026 by acisseJZhong Contributor Loading…
10
[spmd_types] Kimi 2.7 enablement ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#4079 opened Aug 6, 2026 by pianpwk Contributor Loading…
2
Support oversharded QKV heads in DistributedMuon ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#4078 opened Aug 6, 2026 by weifengpy Contributor • Draft
Support explicit replicated Muon compute ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#4077 opened Aug 6, 2026 by weifengpy Contributor • Draft
Remove renderer from Rollouter group API ciflow/rl ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#4076 opened Aug 6, 2026 by pzhan9 Contributor Loading…
Mask loss at document boundaries ciflow/rocm ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#4075 opened Aug 6, 2026 by francesco-bertolotti Contributor Loading…
5
Run RolloutWorker in a Monarch actor mesh ciflow/rl ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#4074 opened Aug 5, 2026 by pzhan9 Contributor Loading…
4
Refactor rollout execution into RolloutWorker ciflow/rl ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#4073 opened Aug 5, 2026 by pzhan9 Contributor Loading…
3
Run InterGeneratorRouter inside a monarch actor ciflow/rl ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#4072 opened Aug 5, 2026 by pzhan9 Contributor Loading…
4
[do not review] inference moe padding ciflow/rl ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#4067 opened Aug 5, 2026 by acisseJZhong Contributor • Draft
[ROCm][CI] Skip cp_spmd_types on ROCm pending upstream spmd_types fix ciflow/rocm ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot. module: rocm
#4065 opened Aug 4, 2026 by rishisinhanj Contributor Loading…
8
[Kimi K2.7] Add DistributedMuon and flex_optimizer_reshard for all-to-all/compute overlap ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#4060 opened Aug 4, 2026 by weifengpy Contributor Loading…
1
[docs]: document environment variables CLA Signed This label is managed by the Meta Open Source bot.
#4059 opened Aug 4, 2026 by gtnv Loading…
1
Add torch_checkpointing save config plumbing (#4058) ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot. meta-exported
#4058 opened Aug 3, 2026 by ivy-zhou Loading…
2
[bugfix]: fix VLM MFU miscomputation ciflow/8gpu CLA Signed This label is managed by the Meta Open Source bot.
#4057 opened Aug 3, 2026 by gtnv Loading…
1
1
ProTip! Add no:assignee to see everything that’s not assigned.