Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

有关对预训练模型微调的问题 #128

Open
Edisonhimself opened this issue Feb 6, 2024 · 0 comments
Open

有关对预训练模型微调的问题 #128

Edisonhimself opened this issue Feb 6, 2024 · 0 comments

Comments

@Edisonhimself
Copy link

作者大佬您好!
我想先通过“model = GPT2LMHeadModel.from_pretrained(args.pretrained_model)”加载预训练模型然后在它的基础上进行微调
我想问您的代码中这样进行微调的方式是在加载的模型的参数的基础上进行全参数微调吗?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant