Skip to content

Commit

Permalink
bumping flash attention version (#3489)
Browse files Browse the repository at this point in the history
  • Loading branch information
ShashankMosaicML authored Jul 24, 2024
1 parent 29401b8 commit c5542a3
Showing 1 changed file with 1 addition and 1 deletion.
2 changes: 1 addition & 1 deletion docker/Dockerfile
Original file line number Diff line number Diff line change
Expand Up @@ -261,7 +261,7 @@ RUN if [ -n "$MOFED_VERSION" ] ; then \
RUN if [ -n "$CUDA_VERSION" ] ; then \
pip${PYTHON_VERSION} install --upgrade --no-cache-dir ninja==1.11.1 && \
pip${PYTHON_VERSION} install --upgrade --no-cache-dir --force-reinstall packaging==22.0 && \
MAX_JOBS=1 pip${PYTHON_VERSION} install --no-cache-dir --no-build-isolation flash-attn==2.6.1; \
MAX_JOBS=1 pip${PYTHON_VERSION} install --no-cache-dir --no-build-isolation flash-attn==2.6.2; \
cd .. ; \
fi

Expand Down

0 comments on commit c5542a3

Please sign in to comment.