Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[feat] add interactive notebook #214

Open
wants to merge 6 commits into
base: master
Choose a base branch
from
Open

[feat] add interactive notebook #214

wants to merge 6 commits into from

Conversation

Nijikadesu
Copy link

@Nijikadesu Nijikadesu commented Feb 23, 2025 •
edited
Loading

Description

这个 PR 添加了项目部分代码的 Notebook 分解示例：

  • tokenizer、model (dense)、dataset 的模块化分解
  • pretrain、sft、dpo 的训练流程分解

@Nijikadesu Nijikadesu mentioned this pull request Feb 23, 2025
Open
@Nijikadesu
Copy link
Author

Nijikadesu commented Feb 25, 2025 •
edited
Loading

Description

  1. 完成了项目主要代码的 Notebook 分解示例, 包括：
  • tokenizer、model (dense + moe)、dataset 的模块化分解
  • pretrain、sft、dpo、lora、distill、distill reason 的训练流程分解
  1. 重构文件目录，修正不规范表达、增加注释.

目前计划内容基本完成，期待作者大大后续更新！

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@Nijikadesu