Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Add support for data parallel QLoRA training via DeepSpeed Zero stages 0, 1 and 2. #3728
Add support for data parallel QLoRA training via DeepSpeed Zero stages 0, 1 and 2. #3728
Changes from all commits
af00bba
70bde7d
4d89ddb
7d6e708
fcd7d3b
4b43aef
17a71f0
7d65619
a30ba99
c8c273b
1aa8efe
8c525e0
b7d68ae
78da3d9
bd3341f
ada045b
c997d33
a3546f5
5284420
d0c174e
e68a02e
fec3ef4
65855ec
48f353d
9ba3347
b4fdc0e
eb33afd
b3c2496
b14bbeb
f519672
b34ef05
799fcd6
ecf2113
6f70747
2eea6a2
d9d49ce
cd73bd1
483d752
f0099b4
a379712
855d2c1
3a11709
e8cdf27
2cf7f4b
832eb93
fbba8cb
b5b3dd7
2e06e5f
46fae60
File filter
Filter by extension
Conversations
Jump to
There are no files selected for viewing