Skip to content

Commit

Permalink
cite rotary embeddings
Browse files Browse the repository at this point in the history
  • Loading branch information
lucidrains committed Apr 21, 2021
1 parent 73639da commit 9ae49af
Showing 1 changed file with 7 additions and 4 deletions.
11 changes: 7 additions & 4 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -244,10 +244,13 @@ Now your model will have fixed projection matrices across all layers
```

```bibtex
@techreport{zhuiyiroformer,
title = {RoFormer: Transformer with Rotary Position Embeddings - ZhuiyiAI},
author = {Jianlin Su},
@misc{su2021roformer,
title = {RoFormer: Enhanced Transformer with Rotary Position Embedding},
author = {Jianlin Su and Yu Lu and Shengfeng Pan and Bo Wen and Yunfeng Liu},
year = {2021},
url = "https://github.com/ZhuiyiTechnology/roformer",
eprint = {2104.09864},
archivePrefix = {arXiv},
primaryClass = {cs.CL},
url = {https://arxiv.org/abs/2104.09864}
}
```

0 comments on commit 9ae49af

Please sign in to comment.