Downloading multiple files from S3 using 'aws cli' in python

Question

I am trying to download multiple files from S3 using aws cli in python. Using pip install I installed aws cli and was able to successfully pass credentials. But when I try to download multiple files, I get following error: fatal error: invalid literal for int() with base 10: 'us-east-1.amazonaws.com'

My code to download the file looks like this: aws s3 cp "s3://buckets/testtelligence/saurav_shekhar/test/" "C:/HD/Profile data/Downloads" --recursive

Also, my C:\Users\USERNAME\.aws\config is

[default] region = Default region name [None]:us-east-1 output = Default output format [None]: table

I am not sure what that error means and how to resolve this.

Does the CLI work at all? For example, can you do aws s3 ls? Does it work when trying to copy one file (without --recursive)? — John Rotenstein
– John Rotenstein, Commented Jun 26, 2018 at 0:52
No. It gives me the same error. Does that mean that CLI is not working? If yes then any possible resolution. — saurav shekhar
– saurav shekhar, Commented Jun 26, 2018 at 1:15
It sounds like your CLI configuration isn't correct. Please edit your question to show the contents of C:\Users\USERNAME\.aws\config. It should show region=us-east-1 under [default]. See: Configuring the AWS CLI - AWS Command Line Interface — John Rotenstein
– John Rotenstein, Commented Jun 26, 2018 at 1:53
I have edited the question and have added the content of C:\Users\USERNAME\.aws\config — saurav shekhar
– saurav shekhar, Commented Jun 26, 2018 at 2:06
No, that should not be the contents. Please delete that file and run aws configure. It will format the file correctly. — John Rotenstein
– John Rotenstein, Commented Jun 26, 2018 at 2:30

John Rotenstein · Accepted Answer · 2018-06-26 02:32:17Z

1

The contents of your .aws/config file should look like:

[default]
region = us-east-1
output = table

answered Jun 26, 2018 at 2:32

John Rotenstein

273k28 gold badges456 silver badges541 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Downloading multiple files from S3 using 'aws cli' in python

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related