diff --git a/README.md b/README.md index bc54599..29b5b37 100644 --- a/README.md +++ b/README.md @@ -27,3 +27,21 @@ sys.path.insert(0, os.path.expanduser("~/micrograd-pp/python")) * [Train a simple feedforward neural network on MNIST to classify handwritten digits](https://nbviewer.org/github/parsiad/micrograd-pp/blob/main/examples/mnist.ipynb) * [Learn an n-gram model to generate text](https://nbviewer.org/github/parsiad/micrograd-pp/blob/main/examples/n-gram.ipynb) * [Train a decoder-only transformer to generate text](https://nbviewer.org/github/parsiad/micrograd-pp/blob/main/examples/transformer.ipynb) + +## Features + +* **Core** + * ☒ Reverse-mode automatic differentiation (`.backward`) + * ☒ GPU support +* **Layers** + * ☒ BatchNorm1d + * ☒ Dropout + * ☒ Embedding + * ☒ LayerNorm + * ☒ Linear + * ☒ MultiheadAttention + * ☒ ReLU + * ☒ Sequential +* **Optimizers** + * ☐ Adam + * ☒ Stochastic Gradient Descent (SGD)