Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

llama3.x Testbed #87

Open
gotsysdba opened this issue Jan 30, 2025 · 1 comment
Open

llama3.x Testbed #87

gotsysdba opened this issue Jan 30, 2025 · 1 comment
Assignees
@gotsysdba
Milestone
v1.0.0

Comments

@gotsysdba
Copy link
Contributor

Testbed loops on evaluation and never comes back (Ollama running on desktop)
@gotsysdba gotsysdba added this to the v1.0.0 milestone Jan 30, 2025
@gotsysdba gotsysdba self-assigned this Jan 30, 2025
@gotsysdba
Copy link
Contributor Author

Couple things happened here... there's a lot more interaction with the LLM in Langchain; specifically rephrasing questions to be contextually aware and grading the documents for accuracy. In the case of the testbed, rephrasing is not required; so this has been conditional'd out speeding up the responses. Grading is still occurring which will impact performance. This should be looked at in terms of the testbed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@gotsysdba gotsysdba

Labels
None yet
Projects
None yet
Milestone
v1.0.0
Development

No branches or pull requests
1 participant
@gotsysdba