Skip to content

Commit

Permalink
add readme
Browse files Browse the repository at this point in the history
  • Loading branch information
ganisback committed Dec 6, 2024
1 parent 5934e34 commit 5fe505f
Showing 1 changed file with 66 additions and 0 deletions.
66 changes: 66 additions & 0 deletions docker/evaluation/README.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,66 @@
# CSGHUB Nginx Images Building

## Login Container Registry
```bash
OPENCSG_ACR="opencsg-registry.cn-beijing.cr.aliyuncs.com"
OPENCSG_ACR_USERNAME=""
OPENCSG_ACR_PASSWORD=""
echo "$OPENCSG_ACR_PASSWORD" | docker login $OPENCSG_ACR -u $OPENCSG_ACR_USERNAME --password-stdin
```

## Build Multi-Platform Images
```bash
export BUILDX_NO_DEFAULT_ATTESTATIONS=1
export IMAGE_TAG=0.3.5
docker buildx build --platform linux/amd64,linux/arm64 \
-t ${OPENCSG_ACR}/public/opencompass:${IMAGE_TAG} \
-t ${OPENCSG_ACR}/public/opencompass:latest \
-f Dockerfile.opencompass \
--push .
export IMAGE_TAG=0.4.6
docker buildx build --platform linux/amd64,linux/arm64 \
-t ${OPENCSG_ACR}/public/lm-evaluation-harness:${IMAGE_TAG} \
-t ${OPENCSG_ACR}/public/lm-evaluation-harness:latest \
-f Dockerfile.lm-evaluation-harness \
--push .
```
*The above command will create `linux/amd64` and `linux/arm64` images with the tags `${IMAGE_TAG}` and `latest` at the same time.*

## Test the opencompass Image
```bash
docker run \
-e ACCESS_TOKEN=xxxx \
-e MODEL_ID="OpenCSG/csg-wukong-1B" \
-e DATASET_IDS="xzgan/hellaswag" \
-e HF_ENDPOINT=https://hub.opencsg.com \
-e ASCEND_VISIBLE_DEVICES=7 \
-e S3_ACCESS_ID="xxxx" \
-e S3_ACCESS_SECRET="xxxx" \
-e S3_BUCKET="xxxxx" \
-e S3_ENDPOINT="xxxxx" \
-e S3_SSL_ENABLED="true" \
${OPENCSG_ACR}/public/opencompass:${IMAGE_TAG}
```

## Test the lm-evaluation-harness Image
```bash
export IMAGE_TAG=0.4.6
docker run \
--gpus device=7 \
-e ACCESS_TOKEN=xxxx \
-e MODEL_ID="OpenCSG/csg-wukong-1B" \
-e DATASET_IDS="Rowan/hellaswag" \
-e HF_ENDPOINT=https://hub.opencsg.com\
-e S3_ACCESS_ID="xxx" \
-e S3_ACCESS_SECRET="xxx" \
-e S3_BUCKET="xxx" \
-e S3_ENDPOINT="xxx" \
-e S3_SSL_ENABLED="true" \
${OPENCSG_ACR}/public/lm-evaluation-harness:${IMAGE_TAG}
```

## inference image name, version and cuda version
| Latest Image | Version | CUDA Version |
| --- | --- | --- |
| opencompass | 0.3.5 | 12.4 |
| lm-evaluation-harness | 0.4.6 | 12.4 |

0 comments on commit 5fe505f

Please sign in to comment.