PUT files in S3 using CURL and instance profile - InvalidAccessKeyId The AWS Access Key Id you provided does not exist in our records

Question

I am trying to PUT files from EC2 to S3 using bash/curl and instance profile. I am using the following code:

instance_profile=`curl http://169.254.169.254/latest/meta-data/iam/security-credentials/`
aws_access_key_id=`curl http://169.254.169.254/latest/meta-data/iam/security-credentials/${instance_profile} | grep AccessKeyId | cut -d':' -f2 | sed 's/[^0-9A-Z]*//g'`
aws_secret_access_key=`curl http://169.254.169.254/latest/meta-data/iam/security-credentials/${instance_profile} | grep SecretAccessKey | cut -d':' -f2 | sed 's/[^0-9A-Za-z/+=]*//g'
token=`curl -s http://169.254.169.254/latest/meta-data/iam/security-credentials/${instance_profile} | sed -n '/Token/{p;}' | cut -f4 -d'"'
file="test_file.txt"
bucket="MM-test-s3-bucket"
filepath="/${bucket}/${path}/${file}"
contentType="application/x-compressed-tar"
dateValue=`date -R`
signature_string="PUT\n\n${contentType}\n${dateValue}\n${filepath}"
signature_hash=`echo -en ${signature_string} | openssl sha1 -hmac ${aws_secret_access_key} -binary | base64`

curl -X PUT -T "${file}" -H "Host: ${bucket}.s3.amazonaws.com" -H "Date: ${dateValue}" -H "Content-Type: ${contentType}" -H "Authorization: AWS ${aws_access_key_id}:${signature_hash}" https://${bucket}.s3.amazonaws.com/${file}

I am getting an error "InvalidAccessKeyIdThe AWS Access Key Id you provided does not exist in our records."

Since the access key starts with ASIA, it's a temporary credentials. You also need to include the security token in the request. — jellycsc
– jellycsc, Commented Jul 12, 2022 at 12:48
Thanks! That issue is gone. Now getting the error "The request signature we calculated does not match the signature you provided. Check your key and signing method." — Muneeb
– Muneeb, Commented Jul 12, 2022 at 13:39
This is probably related to this: stackoverflow.com/questions/30518899/… — X-Men
– X-Men, Commented Jul 13, 2022 at 3:25

Akshay Verma · Accepted Answer · 2023-02-13 12:02:36Z

2

As mentioned in the questions' comment, we need to use token when using temporary access keys and secret key.

Also, we need to add this token in our stringToSign and headers in curl request.

stringToSign="PUT\n\n${contentType}\n${dateValue}\n${CanonicalizedAmzHeaders}\n${filepath}".

Where this CanonicalizedAmzHeaders is - CanonicalizedAmzHeaders="x-amz-security-token:${token}"

and in header in curl request in below format- -H "x-amz-security-token: ${token}"

else you will face error "The request signature we calculated does not match the signature you provided"

answered Feb 13, 2023 at 12:02

Akshay Verma

615 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

PUT files in S3 using CURL and instance profile - InvalidAccessKeyId The AWS Access Key Id you provided does not exist in our records

1 Answer 1

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related