Skip to content

Commit

Permalink
Upgrade torch to 2.2.1 to resolve some issues (#1388)
Browse files Browse the repository at this point in the history
Related issues were discussed:
huggingface/transformers#28731,
Lightning-AI/litgpt#327.

The solution used was to upgrade the `torch` version to `2.2.1` which is
referenced
[comment](huggingface/transformers#28731 (comment)),
and [colab release
note](https://colab.research.google.com/notebooks/relnotes.ipynb#scrollTo=59f6f87f).

For example, some notebooks encountered the above problem and had to
temporarily fix the error with the following code:

```python
import torch
torch.backends.cuda.enable_mem_efficient_sdp(False)
torch.backends.cuda.enable_flash_sdp(False)
```

- [Ghost 7B Alpha - Playground using Transformers,
en](https://www.kaggle.com/code/lamhieu/ghost-7b-alpha-playground-using-transformers-en)
- [Ghost 7B Alpha - Playground using Transformers,
vi](https://www.kaggle.com/code/lamhieu/ghost-7b-alpha-playground-using-transformers-vi)

---------

Co-authored-by: Dustin H <[email protected]>
  • Loading branch information
lh0x00 and djherbis authored May 3, 2024
1 parent 60328f8 commit f8047d1
Showing 1 changed file with 4 additions and 4 deletions.
8 changes: 4 additions & 4 deletions config.txt
Original file line number Diff line number Diff line change
Expand Up @@ -3,10 +3,10 @@ BASE_IMAGE_TAG=m114
CPU_BASE_IMAGE_NAME=tf2-cpu.2-15.py310
GPU_BASE_IMAGE_NAME=tf2-gpu.2-15.py310
LIGHTGBM_VERSION=4.2.0
TORCH_VERSION=2.1.2
TORCHAUDIO_VERSION=2.1.2
TORCHTEXT_VERSION=0.16.2
TORCHVISION_VERSION=0.16.2
TORCH_VERSION=2.2.1
TORCHAUDIO_VERSION=2.2.1
TORCHTEXT_VERSION=0.17.1
TORCHVISION_VERSION=0.17.1
JAX_VERSION=0.4.23
CUDA_MAJOR_VERSION=12
CUDA_MINOR_VERSION=1

0 comments on commit f8047d1

Please sign in to comment.