v0.13.0

🚀 LLM Foundry v0.13.0

🛠️ Bug Fixes & Cleanup

Pytorch 2.4 Checkpointing (#1569, #1581, #1583)

Resolved issues related to checkpointing for Curriculum Learning (CL) callbacks.

🔧 Dependency Updates

Bumped tiktoken from 0.4.0 to 0.8.0 (#1572)
Updated onnxruntime from 1.19.0 to 1.19.2 (#1590)

What's Changed

• Update mcli yamls by @dakinggg in #1552
• Use allenai/c4 instead of c4 dataset by @eitanturok in #1554
• Tensor Parallelism by @eitanturok in #1521
• Insufficient Permissions Error when trying to access table by @KuuCi in #1555
• Add NoOp optimizer by @snarayan21 in #1560
• Deterministic GCRP Errors by @KuuCi in #1559
• Simplify CL API by @b-chu in #1510
• Reapply #1389 by @dakinggg in #1561
• Add dataset swap callback by @b-chu in #1536
• Add error to catch more unknown example types by @milocress in #1562
• Add FileExtensionNotFoundError by @b-chu in #1564
• Add InvalidConversationError by @b-chu in #1565
• Release docker img by @KuuCi in #1547
• Revert FT dataloader changes from #1561, keep #1564 by @snarayan21 in #1566
• Cleanup TP by @eitanturok in #1556
• Changes for dataset swap callback by @gupta-abhay in #1569
• Do not consider run_name when auto-detecting autoresume by @irenedea in #1571
• Allow parameters with requires_grad=False in meta init by @sashaDoubov in #1567
• Bump tiktoken from 0.4.0 to 0.8.0 by @dependabot in #1572
• Add extensions to FinetuningFileNotFoundError by @b-chu in #1578
• Handle long file names in convert text to mds by @irenedea in #1579
• Set streaming log level by @mvpatel2000 in #1582
• Fix pytorch checkpointing for CL callback by @b-chu in #1581
• Fix pytorch checkpointing for CL callback by @b-chu in #1583
• Error if filtered dataset contains 0 examples by @irenedea in #1585
• Change cluster errors from NetworkError to UserError by @irenedea in #1586
• Do not autoresume if a default name is set, only on user defined ones by @irenedea in #1588
• Bump onnxruntime from 1.19.0 to 1.19.2 by @dependabot in #1590
• Make FinetuningStreamingDataset parameters more flexible by @XiaohanZhangCMU in #1580
• Add build callback tests by @irenedea in #1577
• Bump version to 0.14.0.dev0 by @irenedea in #1587
• Fix typo in eval code by using 'fsdp' instead of 'fsdp_config' by @irenedea in #1593

Full Changelog: v0.12.0...v0.13.0