Skip to content

Commit

Permalink
[Application] add README for LLaMA application
Browse files Browse the repository at this point in the history
- remove vocab.json and merges.txt files since each llama version utilizes distinct vocab.json and merges.txt files.
- add README.md file for LLaMA application.

Signed-off-by: Seungbaek Hong <[email protected]>
  • Loading branch information
baek2sm authored and jijoongmoon committed Nov 8, 2024
1 parent 27448b6 commit d0ed9b4
Show file tree
Hide file tree
Showing 3 changed files with 19 additions and 95,732 deletions.
19 changes: 19 additions & 0 deletions Applications/LLaMA/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,19 @@
# LLaMA

This application is an implementation of LLaMA.

It has been verified to run in Ubuntu and Android environments through meson build.

Reference:
- [Paper: The Llama 3 Herd of Models](https://arxiv.org/abs/2407.21783)

## How to run LLaMA

Please refer to the following documents for instructions on setting up and building NNTrainer.

- [Getting Started](../../docs/getting-started.md)
- [how-to-run-example-android](../../docs/how-to-run-example-android.md)

To run your own LLaMA model, you need to prepare three additional files inside the application build directory.
- For tokenizer usage, you will require a `vocab.json` file and a `merges.txt` file tailored to your specific model.
- To load pre-trained weights, ensure that you have a `.bin` file compatible with NNTrainer. You can convert your PyTorch model's weight file to NNTrainer model's weights file using the `Applications/LLaMA/PyTorch/weights_converter.py` script provided within our official repository.
Loading

0 comments on commit d0ed9b4

Please sign in to comment.