Boto3 Python Get only certain file types?

Question

I have

data = list(bucket.objects)

this will get me all of the objects in my aws s3 bucket
I want to be able to get only certain file types, such as a .png file.
i tried doing something like

data = list(bucket.objects.filter(Prefix = '*.png'))

but no luck. Any tips?

Prefix isn't going to work, because you are looking for the suffix, not the prefix. S3 doesn't index files by file extension, so you can't really do what you are asking without indexing the files via some other service. stackoverflow.com/questions/4709071/… — Mark B
– Mark B, Commented Oct 2, 2018 at 19:10

adjr2 · Accepted Answer · 2019-05-02 16:41:24Z

2

I guess the following should help:

client=boto3.client('s3',aws_access_key_id,aws_secret_access_key,region_name)
paginator = client.get_paginator('list_objects')

page_iterator_1 = paginator.paginate(Bucket='bucket-name',PaginationConfig={'PageSize':1})
page_iterator = page_iterator_1.search("Contents[?contains(Key,'png')].Key")

for page in page_iterator:
    print(page) # will contain the entire response

answered May 2, 2019 at 16:41

adjr2

538 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

mbadawi23 Over a year ago

page_iterator_1.search() happens client side unlike the filtering that happens using Prefix. For those looking for more information on that, see [official boto3 page] (boto3.amazonaws.com/v1/documentation/api/latest/guide/…) on filtering and JMESPath documentation.

Collectives™ on Stack Overflow

Boto3 Python Get only certain file types?

1 Answer 1

1 Comment

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

1 Comment

Your Answer

Sign up or log in

Post as a guest

Linked

Related