Skip to content

Commit

Permalink
Update README.md
Browse files Browse the repository at this point in the history
  • Loading branch information
melvinebenezer authored Apr 15, 2024
1 parent 4b5d7b5 commit 7526d43
Showing 1 changed file with 6 additions and 1 deletion.
7 changes: 6 additions & 1 deletion README.md
Original file line number Diff line number Diff line change
Expand Up @@ -32,7 +32,12 @@ retrieve: **"Who painted the Mona Lisa?"**
llm = LLM(model="meta-llama/Llama-2-70b-hf", tensor_parallel_size=4, max_model_len=1500) # need 4 A100s 40GB

#Create Liah
liah = Liah(max_context_length=2000)
liah = Liah(
model_name="Your Model",
max_context_length=2000,
context_length_interval=10,
test_mode=True,
)

#Get a sample from different depths and context_lengths
for i, sample in enumerate(liah.getSample()):
Expand Down

0 comments on commit 7526d43

Please sign in to comment.