The dependency py-rust-stemmers cannot be downloaded in a pure Python environment.

[gbaian10]

I'm currently using Python 3.13, and when I use version 0.4.1, I find that the ONNX build speed is very slow.

I later found in this issue that the problem is related to ONNX's support for Python 3.13.

I later discovered in this repo that version 0.5.1 removed the dependency on onnx.

However, in this repo, after version 0.4.2, pystemmer was replaced with py-rust-stemmers.
#354 (comment)

When I tried to install py-rust-stemmers, it mentioned using maturin for building, which required me to install Rust-related packages.
This means I have to install Rust additionally in Docker or CI environments to handle this issue.

Is there any way to easily install py-rust-stemmers without installing Rust-related packages?

Or could pystemmer and py-rust-stemmers` be made into an optional download method?

[joein]

hey @gbaian10

Sorry for the late response
It seems that py-rust-stemmers does not have a pre-built wheel for your setup, maturin is not required on the os for which py-rust-stemmer distributes a pre-built wheel
Could you please tell us the OS and architecture you're using fastembed on, so we could check whether it is possible to build a wheel for your OS?

[joein]

The problem is that py-rust-stemmers is not building wheels for python3.13 yet, we'll address it

[gbaian10]

Sorry for the late response It seems that py-rust-stemmers does not have a pre-built wheel for your setup, maturin is not required on the os for which py-rust-stemmer distributes a pre-built wheel Could you please tell us the OS and architecture you're using fastembed on, so we could check whether it is possible to build a wheel for your OS?

FROM python:3.13-slim-bookworm
RUN pip install fastembed

[joein]

hey @gbaian10
We've released py-rust-stemmers 0.1.5, could you please give it a try?

We might need to update mmh3 dependency though

[gbaian10]

hey @gbaian10 We've released py-rust-stemmers 0.1.5, could you please give it a try?

We might need to update mmh3 dependency though

FROM python:3.13-slim-bookworm
RUN apt-get update && apt-get install -y gcc
RUN pip install fastembed

It seems that I only need to install gcc to solve the mmh3 problem.

This has already solved many problems. Thank you for your help.