Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Changed transformers_client design so it can support most (all?) HuggingFace models #208

Open
wants to merge 36 commits into
base: main
Choose a base branch
from
Open

Changed transformers_client design so it can support most (all?) HuggingFace models #208

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
36 commits
Select commit Hold shift + click to select a range
e8a690b
DRAFT: merge TransformerClient & TransformerEmbedder into 1 class.
adjahossoualexandre Aug 28, 2024
123396c
Fixed typo.
adjahossoualexandre Aug 29, 2024
2121774
Added type hints to signatures + removed now useless model_type.
adjahossoualexandre Aug 29, 2024
e2023b2
Removed now useless model_types.
adjahossoualexandre Aug 29, 2024
a93bd6a
Added test for TransformerEmbeddingModelClient execution.
adjahossoualexandre Aug 29, 2024
424cbfb
Changed my mind.
adjahossoualexandre Sep 3, 2024
ef2783d
Changed my mind. removing model type might introduce issues.
adjahossoualexandre Sep 3, 2024
3601445
Removed now useless argument.
adjahossoualexandre Sep 3, 2024
3cdab7b
Removed now useless arguments.
adjahossoualexandre Sep 3, 2024
2d1152f
DRAFT: merge TransformerClient and TransformerLLM in 1 class.
adjahossoualexandre Sep 3, 2024
d839eda
Multiline message:
adjahossoualexandre Sep 4, 2024
7daf8ae
Added ests for TransformerLLMModelClient.
adjahossoualexandre Sep 6, 2024
a4eb3bb
Removed temporary log.
adjahossoualexandre Sep 6, 2024
6a9c657
Changed my mind: added model_type back into call().
adjahossoualexandre Sep 6, 2024
cd1823b
Changed my mind about model type. See prev commit.
adjahossoualexandre Sep 6, 2024
2bf711a
Ensured tokenizer_kwargs has 'return_tensors' set to 'pt' by default.
adjahossoualexandre Sep 9, 2024
570c8b1
DRAFT: merge TransformerClient and TransformerReranker in 1 class.
adjahossoualexandre Sep 9, 2024
881cfb6
Commented out old classes.
adjahossoualexandre Sep 9, 2024
bd610d2
Added tests for TransformerRerankerModelClient.
adjahossoualexandre Sep 9, 2024
25fe834
Add test for llm response + remove test for old class.
adjahossoualexandre Sep 9, 2024
e3b3b25
Fixed test class name.
adjahossoualexandre Sep 9, 2024
2c6ee8c
Multiline message:
adjahossoualexandre Sep 9, 2024
1bd8545
Deleted code for the old TransformerClientClass.
adjahossoualexandre Sep 9, 2024
0059bbf
Added __doc__ for the client classes.
adjahossoualexandre Sep 9, 2024
53d5384
Formatting.
adjahossoualexandre Sep 10, 2024
be8041c
Added example for transformers_client module + fixed import.
adjahossoualexandre Sep 10, 2024
f4abfeb
Restored originial file.
adjahossoualexandre Sep 10, 2024
39f2ae2
Fixed test class name.
adjahossoualexandre Sep 11, 2024
5481ee7
Added kwargs for model and tokenizer init.
adjahossoualexandre Sep 11, 2024
eab39cd
Fixed typo.
adjahossoualexandre Sep 11, 2024
dcd3a7a
Fixed missing tokenizer_kwargs in TransformerLLMModelClient.
adjahossoualexandre Sep 11, 2024
8e39e01
Addded local_files_only to TransformerEmbeddingModelClient
adjahossoualexandre Sep 11, 2024
92faa91
Fixed mutable default arguments.
adjahossoualexandre Sep 11, 2024
6e5f109
Removed dict args that were conflicting with @lru_cache.
adjahossoualexandre Sep 11, 2024
508079d
Added tests to check transformer_client compatibility with different …
adjahossoualexandre Sep 11, 2024
c8fe73a
Formatting.
adjahossoualexandre Sep 11, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading