v0.0.8.3-cu124

What's New ✨

• Added image generation model support: SD3 and Flux (#75)
• Added NLP model support: OpenELM and Phi3.5
• Implemented logits through API (#67)

Improvements 🔧

• Added more SDK development examples (examples)
• Added RoCM support for AMD GPUs (#90)

Fixes 🐞

• Fixed server issue: execute curl command on Windows (#79)
• Fixed nanoLlava file mapping issue (#68)

Upgrade Guide 📝

To upgrade the NexaAI SDK for GPU use with CUDA, follow these steps based on your operating system:

For Linux:

CMAKE_ARGS="-DGGML_CUDA=ON -DSD_CUBLAS=ON" pip install -U nexaai --prefer-binary --index-url https://nexaai.github.io/nexa-sdk/whl/cu124 --extra-index-url https://pypi.org/simple --no-cache-dir

For Windows:

• PowerShell:

$env:CMAKE_ARGS="-DGGML_CUDA=ON -DSD_CUBLAS=ON"; pip install -U nexaai --prefer-binary --index-url https://nexaai.github.io/nexa-sdk/whl/cu124 --extra-index-url https://pypi.org/simple --no-cache-dir

• Command Prompt:

set CMAKE_ARGS="-DGGML_CUDA=ON -DSD_CUBLAS=ON" & pip install -U nexaai --prefer-binary --index-url https://nexaai.github.io/nexa-sdk/whl/cu124 --extra-index-url https://pypi.org/simple --no-cache-dir

• Git Bash:

CMAKE_ARGS="-DGGML_CUDA=ON -DSD_CUBLAS=ON" pip install -U nexaai --prefer-binary --index-url https://nexaai.github.io/nexa-sdk/whl/cu124 --extra-index-url https://pypi.org/simple --no-cache-dir

These commands will upgrade your existing NexaAI SDK installation to the latest CUDA-compatible version.

Note

If you encounter any issues or want to ensure a clean installation:

1. Uninstall the current version:

   pip uninstall nexaai

2. Reinstall the package using the appropriate command for your system as listed above, but without the -U flag.

For more detailed installation instructions, please refer to the Installation section in the README.

Full Changelog - v0.0.8.2...v0.0.8.3