| Date | Content | Link |
|---|---|---|
| 2025.02.03- | Differential Transformer | In Progress... |
| 2024.10.28-11.22 | Kolmogorov-Arnold Network | blog code |
| 2024.08.06-10.21 | Mixture of Experts | blog code |
| 2024.05.23-07.28 | DDPM & DDIM | blog code |
| 2024.04.21-05.21 | Understanding Diffusion Models | blog code |
| 2024.02.26-04.16 | ConvNeXt V2 | blog code |
| 2024.02.22 | cosine scheduler with min lr | code |
| 2024.02.22 | noisynn | code |
| 2024.02.21 | EMA | code |
| 2024.02.11 | layernorm | code |
| 2024.02.05-23 | ConvNeXt V1 | blog code |
| 2024.01.25 | 1x1 Conv vs Linear | code |
| 2024.01.20-02.08 | Convolutional Vision Transformer | blog code |
| 2024.01.19 | Quick GeLU | code |
| 2024.01.02-18 | Swin Transformer V2 | blog code |
| 2023.12.15-31 | Swin Transformer V1 | blog code |
| 2023.12.02-17 | Vision Transformer | blog code |
| 2023.11.26-12.02 | Transformer Intermediate | blog code |
| 2023.11.11-23 | Transformer Basic | blog code |
| 2023.11.09 | ReLU, Swish, GELU | code |
| 2023.11.03 | dl_framework keras3 | code |
| 2023.10.25 | python dataclasses | code |
| 2023.10.24 | streamlit scroll | blog code #1 code #2 code #3 |
| 2023.10.23 | python lru_cache | blog code |
- LayerSkip: Enabling Early Exit Inference and Self-Speculative Decoding
- Differential Transformer
- [Mamba](Mamba: Linear-Time Sequence Modeling with Selective State Spaces)
- Kolmogorov-Arnold Network
- Mixture of Experts
- DDPM
- DDIM
- Understanding Diffusion Models
- ConvNeXt V2
- ConvNeXt V1
- Swin V2
- Swin V1
- ViT
- Attention is All you need