transformers 4.48 breaks Mistral FastLanguageModel.from_pretrained with NameError: name 'MistralConfig' is not defined

[ArnoBen]

Greetings,

I've been trying to run the Mistral_v0.3_(7B)-Conversational notebook on my own server.
I followed the notebook cells and was hit with NameError: name 'MistralConfig' is not defined, from this file:
unsloth/models/mistral.py, Line 310
even though from transformers import MistralConfig works fine.

Since it's running fine on Colab's server, I checked the package versions and noticed that Colab had transformers==4.47.1 whereas I was running 4.48.0.

Downgrading to 4.47.1 fixed the issue but this will currently break when simply pip-installing unsloth calling the method with a Mistral model.

[InshaManowar]

Traceback (most recent call last): File "/opt/conda/lib/python3.11/site-packages/unsloth/models/llama.py", line 1610, in from_pretrained model_patcher.pre_patch() File "/opt/conda/lib/python3.11/site-packages/unsloth/models/mistral.py", line 310, in pre_patch exec(function, globals()) File "<string>", line 1, in <module> NameError: name 'MistralConfig' is not defined

Got the same error, but downgrading transformer to 4.47.1 worked.

[danielhanchen]

Apologies on the delay - working on a fix as we speak!