environments tensorflow 2.16 cuda11

tensorflow-2.16-cuda11

Overview

An environment for deep learning with Tensorflow containing the Azure ML SDK and additional python packages.

Version: 16

Tags

Tensorflow : 2.16 GPU : Cuda11 OS : Ubuntu20.04 Training Preview Python : 3.9

View in Studio: https://ml.azure.com/registries/azureml/environments/tensorflow-2.16-cuda11/version/16

Docker image: mcr.microsoft.com/azureml/curated/tensorflow-2.16-cuda11:16

Docker build context

Dockerfile

FROM mcr.microsoft.com/azureml/openmpi4.1.0-cuda11.8-cudnn8-ubuntu22.04:20240918.v1

WORKDIR /

ENV CONDA_PREFIX=/azureml-envs/tensorflow-2.16-cuda11
ENV CONDA_DEFAULT_ENV=$CONDA_PREFIX
ENV PATH=$CONDA_PREFIX/bin:$PATH

# Enable debug
RUN apt-get update
RUN apt-get install -y openssh-server openssh-client

# Create conda environment
COPY conda_dependencies.yaml .
RUN conda env create -p $CONDA_PREFIX -f conda_dependencies.yaml -q && \
    rm conda_dependencies.yaml && \
    conda run -p $CONDA_PREFIX pip cache purge && \
    conda clean -a -y

RUN conda run -p $CONDA_PREFIX

RUN HOROVOD_WITH_TENSORFLOW=1 pip install horovod[tensorflow]

# This is needed for mpi to locate libpython
ENV LD_LIBRARY_PATH=$CONDA_PREFIX/lib:$LD_LIBRARY_PATH