Skip to content

Commit

Permalink
Add note
Browse files Browse the repository at this point in the history
  • Loading branch information
pseudotensor committed Mar 2, 2024
1 parent 81e41a0 commit 883f2f6
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions docs/README_WHEEL.md
Original file line number Diff line number Diff line change
Expand Up @@ -13,6 +13,7 @@ Install in fresh env, avoiding being inside h2ogpt directory or a directory wher
```bash
export CUDA_HOME=/usr/local/cuda-12.1
export PIP_EXTRA_INDEX_URL="https://download.pytorch.org/whl/cu121 https://huggingface.github.io/autogptq-index/whl/cu121"
# the wheel built assumes cuda llama.cpp, need to change reqs_optional/requirements_optional_gpt4all.txt to select desired packages
pip install <h2ogpt_path>/dist/h2ogpt-0.1.0-py3-none-any.whl[cuda]
pip install flash-attn==2.4.2
```
Expand Down

0 comments on commit 883f2f6

Please sign in to comment.