WARNING: This is an early preview that is in progress. It is not ready for general use.
Use this as a guide to get started developing the project using pinned, pre-release dependencies. You are welcome to deviate as you see fit, but these canonical directions mirror what the CI does.
We recommend setting up a virtual environment (venv). The project is configured
to ignore .venv directories, and editors like VSCode pick them up by default.
python -m venv --prompt sharktank .venv
source .venv/bin/activate
If no explicit action is taken, the default PyTorch version will be installed. This will give you a current CUDA-based version. Install a different variant by doing so explicitly first:
CPU:
pip install -r pytorch-cpu-requirements.txt
ROCM:
pip install -r pytorch-rocm-requirements.txt
# Clone and install editable iree-turbine dep in deps/
pip install -f https://iree.dev/pip-release-links.html --src deps \
-e "git+https://github.com/iree-org/iree-turbine.git#egg=iree-turbine"
# Install editable local projects.
pip install -r requirements.txt -e sharktank/ shortfin/
pytest sharktank
pytest shortfin
This project is set up to use the pre-commit tooling. To install it in
your local repo, run: pre-commit install. After this point, when making
commits locally, hooks will run. See https://pre-commit.com/