Skip to content

Commit

Permalink
Update intel-habana-gaudi-inference.md (#44409)
Browse files Browse the repository at this point in the history
* Update intel-habana-gaudi-inference.md

Signed-off-by: Samuel Chan <[email protected]>
  • Loading branch information
anyscalesam authored Apr 3, 2024
1 parent 8aeaf6c commit 676343a
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions doc/source/serve/tutorials/intel-habana-gaudi-inference.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,7 +2,7 @@
orphan: true
---

# Serve a model on Intel Habana Gaudi
# Serve Llama2-7b/70b on a single or multiple Intel Gaudi Habana

[Habana Gaudi AI Processors (HPUs)](https://habana.ai) are AI hardware accelerators designed by Habana Labs. See [Gaudi Architecture](https://docs.habana.ai/en/latest/Gaudi_Overview/index.html) and [Gaudi Developer Docs](https://developer.habana.ai/) for more details.

Expand Down Expand Up @@ -288,4 +288,4 @@ The path was overgrown with weeds and vines, and it looked as though it hadn't b
```

## Next Steps
See [llm-on-ray](https://github.com/intel/llm-on-ray) for more ways to customize and deploy LLMs at scale.
See [llm-on-ray](https://github.com/intel/llm-on-ray) for more ways to customize and deploy LLMs at scale.

0 comments on commit 676343a

Please sign in to comment.