Enable the run_async=False
option for the InferenceClient
.
#100
Job | Run time |
---|---|
35s | |
2m 28s | |
14s | |
3m 17s |
run_async=False
option for the InferenceClient
.
#100
Job | Run time |
---|---|
35s | |
2m 28s | |
14s | |
3m 17s |