Skip to content

Commit

Permalink
add yishan
Browse files Browse the repository at this point in the history
  • Loading branch information
ByronHsu committed Aug 25, 2024
1 parent 8c96d58 commit 016257a
Showing 1 changed file with 1 addition and 0 deletions.
1 change: 1 addition & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -205,6 +205,7 @@ Since Liger Kernel is 100% Triton-based, it works seamlessly with [`torch.compil

## Acknowledgement

- [@claire_yishan](https://twitter.com/claire_yishan) for the LOGO design
- [flash-attn](https://github.com/Dao-AILab/flash-attention) and [Unsloth](https://github.com/unslothai/unsloth) for inspiration in Triton kernels for training
- [tiny shakespeare dataset](https://raw.githubusercontent.com/karpathy/char-rnn/master/data/tinyshakespeare/input.txt) by Andrej Karpathy for convergence testing
- [Efficient Cross Entropy](https://github.com/mgmalek/efficient_cross_entropy) for lm_head + cross entropy inspiration
Expand Down

0 comments on commit 016257a

Please sign in to comment.