This project explores the effects of R-Drop (Regularized Dropout) on different neural network architectures. The experiments can be run by accessing the final_implementation notebook, running the first cell which has all of the function implementations, setting the hyperparameters in the second cell and running it, and then running any of the last cells which conduct training of the models.
-
Notifications
You must be signed in to change notification settings - Fork 0
omartounsi7/R-Drop-ECE570
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
An investigation of the R-Drop technique for regularization neural networks
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published