From f8047d106f2b3c720f0497a9bb5f5cfca96380d9 Mon Sep 17 00:00:00 2001 From: Hieu Lam Date: Fri, 3 May 2024 21:08:36 +0700 Subject: [PATCH] Upgrade `torch` to `2.2.1` to resolve some issues (#1388) Related issues were discussed: https://github.com/huggingface/transformers/issues/28731, https://github.com/Lightning-AI/litgpt/issues/327. The solution used was to upgrade the `torch` version to `2.2.1` which is referenced [comment](https://github.com/huggingface/transformers/issues/28731#issuecomment-1918690108), and [colab release note](https://colab.research.google.com/notebooks/relnotes.ipynb#scrollTo=59f6f87f). For example, some notebooks encountered the above problem and had to temporarily fix the error with the following code: ```python import torch torch.backends.cuda.enable_mem_efficient_sdp(False) torch.backends.cuda.enable_flash_sdp(False) ``` - [Ghost 7B Alpha - Playground using Transformers, en](https://www.kaggle.com/code/lamhieu/ghost-7b-alpha-playground-using-transformers-en) - [Ghost 7B Alpha - Playground using Transformers, vi](https://www.kaggle.com/code/lamhieu/ghost-7b-alpha-playground-using-transformers-vi) --------- Co-authored-by: Dustin H --- config.txt | 8 ++++---- 1 file changed, 4 insertions(+), 4 deletions(-) diff --git a/config.txt b/config.txt index 0a0a98fd..9bef3a48 100644 --- a/config.txt +++ b/config.txt @@ -3,10 +3,10 @@ BASE_IMAGE_TAG=m114 CPU_BASE_IMAGE_NAME=tf2-cpu.2-15.py310 GPU_BASE_IMAGE_NAME=tf2-gpu.2-15.py310 LIGHTGBM_VERSION=4.2.0 -TORCH_VERSION=2.1.2 -TORCHAUDIO_VERSION=2.1.2 -TORCHTEXT_VERSION=0.16.2 -TORCHVISION_VERSION=0.16.2 +TORCH_VERSION=2.2.1 +TORCHAUDIO_VERSION=2.2.1 +TORCHTEXT_VERSION=0.17.1 +TORCHVISION_VERSION=0.17.1 JAX_VERSION=0.4.23 CUDA_MAJOR_VERSION=12 CUDA_MINOR_VERSION=1