Skip to content

Latest commit

 

History

History
6 lines (5 loc) · 334 Bytes

README.md

File metadata and controls

6 lines (5 loc) · 334 Bytes

Some Experiments On Neural Nets

param-trajectory.py shows how the fractal dimension of the trajectory that the model parameters take through parameter space while being optimized varies with different optimization algorithms. Somewhat expectedly, SGD has notably higher fractal dimension than Adam-style optimization algorithms.