Skip to content

Pull requests: pytorch/torchtune

New pull request New
51 Open 1,333 Closed
51 Open 1,333 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[WIP] Add 2D Parallelism (FSDP + Tensor Parallel) LoRA CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2204 opened Dec 24, 2024 by matthew-hippocratic Loading…
7 tasks done
5
lora llama 3.1 can accept specified max_seq_len CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2203 opened Dec 23, 2024 by akashc1 Loading…
2 of 13 tasks
3
[RFC] Online and offline adaptive batching in torchtune. CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2199 opened Dec 22, 2024 by krammnic Loading…
1
Add Phi4 CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2197 opened Dec 21, 2024 by krammnic Loading…
6 of 13 tasks
4
Fix gradient scaling to account for world_size normalization CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2172 opened Dec 18, 2024 by mirceamironenco Loading…
3 of 13 tasks
2
Integrate new released Falcon3 Family base models
#2171 opened Dec 18, 2024 by abdalgader-a Loading…
3
Fixing docstring linter CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2163 opened Dec 17, 2024 by SalmanMohammadi Loading…
1 of 4 tasks
2
Add example recipes for CPU and XPU CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2160 opened Dec 16, 2024 by zxd1997066 • Draft
3 of 13 tasks
4
[RFC] Image Generation Dataset CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. rfc Request for comments
#2140 opened Dec 10, 2024 by calvinpelletier Loading…
23
Migrate distributed state dict API CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. distributed Anything related to distributed env (multi-GPU, multi-node)
#2138 opened Dec 10, 2024 by mori360 Loading…
1 of 4 tasks
7
[RFC] Step-based checkpointing in torchtune CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. rfc Request for comments
#2105 opened Dec 3, 2024 by joecummings Loading…
5
Flux Autoencoder CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2098 opened Dec 2, 2024 by calvinpelletier Loading…
9 of 13 tasks
2
Adding reverse and symmetric KLD losses CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2094 opened Nov 30, 2024 by insop Loading…
8 of 13 tasks
14
Check for attr self._writer in case of import errors on TensorboardLogger CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2092 opened Nov 28, 2024 by joecummings • Draft
13 tasks
1
Implement activation offloading and opt_in_bwd in knowledge_distillation recipes CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2088 opened Nov 27, 2024 by AnuravModak Loading…
2
T5 Encoder CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2069 opened Nov 25, 2024 by calvinpelletier Loading…
9 of 13 tasks
16
PPO Performance Improvements CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. rlhf Anything related to reinforcement learning w/ human feedback
#2066 opened Nov 25, 2024 by SalmanMohammadi Loading…
1
26
Do not require lr_scheduler for all other recipes CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2051 opened Nov 22, 2024 by thomasjpfan Loading…
2 of 13 tasks
1
2
[WIP] compile graph breaks CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#2027 opened Nov 19, 2024 by felipemello1 • Draft
1 of 4 tasks
1
full dpo CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1966 opened Nov 7, 2024 by jxmsML • Draft
1 of 13 tasks
5
[DO NOT LAND] compile more modules CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1938 opened Nov 1, 2024 by felipemello1 • Draft
1 of 4 tasks
2
Llama Vision PEFT CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1937 opened Oct 31, 2024 by pbontrager Loading…
6 of 11 tasks
4
Migrate state dict API to DSD CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1930 opened Oct 30, 2024 by mori360 • Draft
13 tasks
2
Add prompt completion e2e code CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed.
#1907 opened Oct 25, 2024 by qqlabs • Draft
13 tasks
2
[RFC] MOE design in Torchtune CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. rfc Request for comments
#1902 opened Oct 24, 2024 by acisseJZhong Loading…
19
ProTip! Updated in the last three days: updated:>2024-12-21.