Mistral-on-AWS

A collection of notebooks and samples to get started with Mistral models on AWS. Open a PR if you would like to contribute! 🔀

What's New ⭐⭐

• In Depth Exploration of Pixtral Capabilities

• Leverage Nemo 12b & Athena for Text-to-SQL

• RAG w/ LlamaIndex

• Fine-tune Mixtral 8*7b with PyTorch FSDP and Q-Lora on Amazon SageMaker!

• Latest Releases:

  1. Pixtral Capabilities & Deployment Guide
  2. Text-to-SQL Query Generator Using Mistral Nemo 12B and Amazon SageMaker
  3. Large 2 JSON Mode Deep Dive
  4. Agentic RAG application using the Mistral Large 2 Model and LlamaIndex
  5. Compile, Deploy, and Benchmark Mathstral on Inferentia2 with Optimum Neuron and SageMaker

Getting Started 🔌

1. Please visit Amazon Bedrock user guide on how to enable model access.
2. The notebooks are executed from SageMaker studio with Data Science 3.0 image.

Security

See CONTRIBUTING for more information.

Distributors

• AWS
• Mistral

License

This library is licensed under the MIT-0 License. See the LICENSE file.