How to run on AWS with IMDSv2

[jimduden6804]

Hi,

CONTEXT:
We are running the official triton docker image(tritonserver:24.06-py3) on AWS ec2 with an AWS s3 repository.

We only provide the container with the following ENVIRONMENT.

ACCOUNT=${ACCOUNT}
REGION=${REGION}
INSTANCE_ID=${INSTANCE_ID}

This works fine with IMDSv1. The tritonserver gets all credentials vie the metadata endpoint (I assume, since we do not provide an AccessKey)

PROBLEM:
When we enable IMDSv2, we see the error:

error: creating server: Internal - Unable to create S3 filesystem client. Check account credentials. Exception: '' Message: 'No response body.'

SIDE INFO:
From AWS Docs I assume that it should work in IMDSv2 the same way as long as the aws sdk is somewhat up to date.
https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/use-a-supported-sdk-version-for-imdsv2.html
I was not able to find the version of the aws-sdk-cpp used in the latest triton image (tritonserver:24.06-py3)

Did anyone face this issue?
Which aws-sdk-cpp is used? Where can I find it?
Any ideas to make this work with IMDSv2?