Skip to content

Commit

Permalink
Add features to README
Browse files Browse the repository at this point in the history
  • Loading branch information
parsiad committed Aug 29, 2024
1 parent 77ae30e commit b637ecc
Showing 1 changed file with 18 additions and 0 deletions.
18 changes: 18 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -27,3 +27,21 @@ sys.path.insert(0, os.path.expanduser("~/micrograd-pp/python"))
* [Train a simple feedforward neural network on MNIST to classify handwritten digits](https://nbviewer.org/github/parsiad/micrograd-pp/blob/main/examples/mnist.ipynb)
* [Learn an n-gram model to generate text](https://nbviewer.org/github/parsiad/micrograd-pp/blob/main/examples/n-gram.ipynb)
* [Train a decoder-only transformer to generate text](https://nbviewer.org/github/parsiad/micrograd-pp/blob/main/examples/transformer.ipynb)

## Features

* **Core**
* ☒ Reverse-mode automatic differentiation (`.backward`)
* ☒ GPU support
* **Layers**
* ☒ BatchNorm1d
* ☒ Dropout
* ☒ Embedding
* ☒ LayerNorm
* ☒ Linear
* ☒ MultiheadAttention
* ☒ ReLU
* ☒ Sequential
* **Optimizers**
* ☐ Adam
* ☒ Stochastic Gradient Descent (SGD)

0 comments on commit b637ecc

Please sign in to comment.