-
-
Notifications
You must be signed in to change notification settings - Fork 5.3k
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
ExllamaV2 tensor parallelism to increase multi gpu inference speeds code help #6356
Commits on Jul 25, 2024
-
Merge pull request oobabooga#6271 from oobabooga/dev
Merge dev branch
Configuration menu - View commit details
-
Copy full SHA for dd97a83 - Browse repository at this point
Copy the full SHA dd97a83View commit details -
Configuration menu - View commit details
-
Copy full SHA for 498fec2 - Browse repository at this point
Copy the full SHA 498fec2View commit details
Commits on Aug 1, 2024
-
Merge pull request oobabooga#6300 from oobabooga/dev
Merge dev branch
Configuration menu - View commit details
-
Copy full SHA for d011040 - Browse repository at this point
Copy the full SHA d011040View commit details
Commits on Aug 20, 2024
-
Merge pull request oobabooga#6336 from oobabooga/dev
Merge dev branch
Configuration menu - View commit details
-
Copy full SHA for 073694b - Browse repository at this point
Copy the full SHA 073694bView commit details -
Merge pull request oobabooga#6337 from oobabooga/dev
Merge dev branch
Configuration menu - View commit details
-
Copy full SHA for 1b62cd8 - Browse repository at this point
Copy the full SHA 1b62cd8View commit details -
Merge pull request oobabooga#6339 from oobabooga/dev
Merge dev branch
Configuration menu - View commit details
-
Copy full SHA for 5522584 - Browse repository at this point
Copy the full SHA 5522584View commit details
Commits on Aug 29, 2024
-
Code to get exllamaV2 tensor parallelization working.
Configuration menu - View commit details
-
Copy full SHA for 377018e - Browse repository at this point
Copy the full SHA 377018eView commit details
Commits on Aug 31, 2024
-
Configuration menu - View commit details
-
Copy full SHA for 3e44373 - Browse repository at this point
Copy the full SHA 3e44373View commit details
Commits on Sep 28, 2024
-
Configuration menu - View commit details
-
Copy full SHA for dc06495 - Browse repository at this point
Copy the full SHA dc06495View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1a4c054 - Browse repository at this point
Copy the full SHA 1a4c054View commit details -
Configuration menu - View commit details
-
Copy full SHA for 725a463 - Browse repository at this point
Copy the full SHA 725a463View commit details