v0.0.8.5-cu124

What's New ✨

Added support for Llama3.2 models:

Model	Command to Run
Llama3.2 3B	nexa run llama3.2
Llama3.2 1B	nexa run Llama3.2-1B-Instruct:q4_0

Update Nexa SDK 🛠️

CPU Version

To update the CPU version of Nexa SDK, run:

pip install nexaai -U --prefer-binary --index-url https://nexaai.github.io/nexa-sdk/whl/cpu --extra-index-url https://pypi.org/simple --no-cache-dir

GPU Version (Metal - macOS)

For the GPU version supporting Metal (macOS), run:

CMAKE_ARGS="-DGGML_METAL=ON -DSD_METAL=ON" pip install nexaai -U --prefer-binary --index-url https://nexaai.github.io/nexa-sdk/whl/metal --extra-index-url https://pypi.org/simple --no-cache-dir

Other GPU Support

For detailed installation instructions of Nexa SDK for CUDA and AMD GPU support, please refer to the Installation section in the main README.

Note: To update your current SDK version to v0.0.8.5, use the same command as the installation but add a -U flag to the pip install command.