Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Quantization updated to support more OS and architectures #120

Merged
merged 30 commits into from
May 9, 2024
Merged

Quantization updated to support more OS and architectures #120

merged 30 commits into from
May 9, 2024

Conversation

sanchitvj
Copy link
Collaborator

No description provided.

Jenkins and others added 30 commits April 24, 2024 23:37
test status updated
60b37c1
@sanchitvj
Merge branch 'main' of https://github.com/arjbingly/Capstone_5
68db81a
@sanchitvj
Merge branch 'main' of https://github.com/arjbingly/Capstone_5
81c8dc4
@sanchitvj
Merge branch 'main' of https://github.com/arjbingly/Capstone_5
08bd61f
@sanchitvj
quantization modified
9b1af78
@sanchitvj
added inference in quantization
f8923a1
@sanchitvj
Merge remote-tracking branch 'origin/main' into quantize
f7a0fb8
@sanchitvj
added some tests
cf05b50
@sanchitvj
ruff & type checked, all tests passed
a235393
@sanchitvj
Update pyproject.toml
118b2ff
@sanchitvj
Update branch_Jenkinsfile
82c21b4
@sanchitvj
Update branch_Jenkinsfile
b06280a
@sanchitvj
Update branch_Jenkinsfile
783919e
@sanchitvj
added mypy type-requests
afd150e
@arjbingly
Change min python version to 3.10
12cc461
@sanchitvj
added exception for root path
b386cf1
@arjbingly
Syntax error for multiple exceptions
2a8c71c
@arjbingly
Parse yes/no
fa6757d
@sanchitvj
gated repo exception handling
bc9a48d
@arjbingly
Error handling output_dir in quantize_model
26037b8
@arjbingly
Huggingface-cli login response handling
bb6d0c8
@arjbingly
HuggingFace url resolver
5847a3a
@sanchitvj
modified url resolver
305801c 
corrected path issues, type checked, ruff formatted.
@sanchitvj
quantize test passed
c4bc51e
@sanchitvj
lower cased the system and arch
89ca88c
@sanchitvj
support for AMD architecture
9ab317a
@sanchitvj
Update get_started.llms.rst
688bdd1
@sanchitvj
quantize compatible for windows
5a570f6
@sanchitvj
Merge branch 'quantize' of https://github.com/arjbingly/Capstone_5 in…
6f8bc90 
…to quantize
@sanchitvj
Update get_started.llms.rst
78f1d9b
@sanchitvj sanchitvj requested a review from arjbingly May 9, 2024 19:31
@sanchitvj sanchitvj added the enhancement New feature or request label May 9, 2024
This was linked to issues May 9, 2024
Quantization not working for models with BPE tokenizer #102
Closed
LLM Quantize only supports Ubuntu #109
Closed
@arjbingly arjbingly merged commit 75608bb into main May 9, 2024
2 checks passed
@arjbingly arjbingly deleted the quantize branch May 9, 2024 19:33
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@arjbingly arjbingly arjbingly approved these changes

Assignees
No one assigned
Labels
enhancement New feature or request
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.

LLM Quantize only supports Ubuntu Quantization not working for models with BPE tokenizer
2 participants
@sanchitvj @arjbingly