New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Citator Experiments: Bedrock Llama #5072

Open

rachlllg opened this issue Feb 13, 2025 · 0 comments

Assignees

Labels

citator

rachlllg commented Feb 13, 2025

Use Pau's dataset + excerpts + prompt to run through Bedrock Llama models to establish Llama baseline
Tune the prompt to better suit Llama models + look into documentation to force output in json format
Analyze the result and identify the best model + prompt & identify shortfalls

Models (In the order of cheapest + fastest to latest + most intelligent):

Llama 3.2 1B Instruct
Llama 3.2 3B Instruct
Llama 3.3 70B Instruct

rachlllg added the citator label

rachlllg self-assigned this

rachlllg added this to Sprint (Web Team)

rachlllg moved this to To Do in Sprint (Web Team)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment