Added 'sys.append' with EAFP for Colab fine-tuning #1325
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Fine-tuning running in Colab (2024.03.23) On T4 GPU, without bf16 or tf32.
The running is fine after adding paths when importing. The error comes from weak GPU on Colab.
![1711217998533](https://private-user-images.githubusercontent.com/114957703/316261458-6cf998f5-2b83-4e57-82fc-492057b4e2cf.png?jwt=eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJpc3MiOiJnaXRodWIuY29tIiwiYXVkIjoicmF3LmdpdGh1YnVzZXJjb250ZW50LmNvbSIsImtleSI6ImtleTUiLCJleHAiOjE3MzkyNzYzNjMsIm5iZiI6MTczOTI3NjA2MywicGF0aCI6Ii8xMTQ5NTc3MDMvMzE2MjYxNDU4LTZjZjk5OGY1LTJiODMtNGU1Ny04MmZjLTQ5MjA1N2I0ZTJjZi5wbmc_WC1BbXotQWxnb3JpdGhtPUFXUzQtSE1BQy1TSEEyNTYmWC1BbXotQ3JlZGVudGlhbD1BS0lBVkNPRFlMU0E1M1BRSzRaQSUyRjIwMjUwMjExJTJGdXMtZWFzdC0xJTJGczMlMkZhd3M0X3JlcXVlc3QmWC1BbXotRGF0ZT0yMDI1MDIxMVQxMjE0MjNaJlgtQW16LUV4cGlyZXM9MzAwJlgtQW16LVNpZ25hdHVyZT1lNzhhOTA1ZmZjNGVmZmFhN2UxNzBkMTgxMGU3MWFiYjU1NWVjNjViOTY0N2ZhNzczMzVhODQwZDNmZTkwYTUxJlgtQW16LVNpZ25lZEhlYWRlcnM9aG9zdCJ9.K8U6m38ggqrnmZRnf17ZMRthZSIcXaGQmI4XIRz2C4E)