Skip to content

Commit

Permalink
improve guide
Browse files Browse the repository at this point in the history
  • Loading branch information
WaelKarkoub committed May 5, 2024
1 parent 1cab419 commit 8a9fc96
Showing 1 changed file with 1 addition and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -130,7 +130,7 @@ The framework's architecture is designed so that it can be seamlessly integrated

## Example 3: Modifying LLMLingua's Compression Parameters

LLMLingua can be configured to compress text in a variety of ways. For example, we can pass in new instructions to the LLM or setting target token counts for compression. We'll be showcasing on how to set the target token count to allow us to use models with smaller context size like gpt-3.5.
LLMLingua's flexibility allows for various configurations, such as customizing instructions for the LLM or setting specific token counts for compression. This example demonstrates how to set a target token count, enabling the use of models with smaller context sizes like gpt-3.5.

```python
config_list = [{"model": "gpt-3.5-turbo", "api_key": os.getenv("OPENAI_API_KEY")}]
Expand Down

0 comments on commit 8a9fc96

Please sign in to comment.