Skip to content

Commit

Permalink
fixed readme typo
Browse files Browse the repository at this point in the history
  • Loading branch information
Algomancer authored Nov 3, 2023
1 parent 1699d7e commit bee3fc5
Showing 1 changed file with 1 addition and 2 deletions.
3 changes: 1 addition & 2 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,8 +2,7 @@

A PyTorch implementation of [Bayesian Flow Networks](https://arxiv.org/abs/2308.07037)

Currently use of a non causal version of LLAMA2. Currently training TinyStories Models matching https://github.com/karpathy/llama2.c/tree/master

Currently using for a non causal version of LLAMA2.

I am going to be using this repository to explore training dynamics of this new class of models. I will maintain a minimal implimentation in the Minimal.ipynd for a simple BFN implimentation. Everything else is an early work in progress.

Expand Down

0 comments on commit bee3fc5

Please sign in to comment.