v0.0.8.3-metal

What's New ✨

• Added image generation model support: SD3 and Flux (#75)
• Added NLP model support: OpenELM and Phi3.5
• Implemented logits through API (#67)

Improvements 🔧

• Added more SDK development examples (examples)
• Added RoCM support for AMD GPUs (#90)

Fixes 🐞

• Fixed server issue: execute curl command on Windows (#79)
• Fixed nanoLlava file mapping issue (#68)

Upgrade Guide 📝

To upgrade the NexaAI SDK for GPU use with Metal on macOS, follow these steps:

1. Open a terminal.

2. Run the following command:

CMAKE_ARGS="-DGGML_METAL=ON -DSD_METAL=ON" pip install -U nexaai --prefer-binary --index-url https://nexaai.github.io/nexa-sdk/whl/metal --extra-index-url https://pypi.org/simple --no-cache-dir

This command will upgrade your existing NexaAI SDK installation to the latest Metal-compatible version.

Note

If you encounter any issues or want to ensure a clean installation:

1. Uninstall the current version:

   pip uninstall nexaai

2. Reinstall the package using this command:

   CMAKE_ARGS="-DGGML_METAL=ON -DSD_METAL=ON" pip install nexaai --prefer-binary --index-url https://nexaai.github.io/nexa-sdk/whl/metal --extra-index-url https://pypi.org/simple --no-cache-dir

For more detailed installation instructions, please refer to the Installation section in the README.

Full Changelog - v0.0.8.2...v0.0.8.3