how to upload json to s3 with the help of lambda python?

Question

I want to upload the JSON file to the s3 bucket with the help of lambda. I have added pandas to the layer already. there is no issue with permissions. can also if also want to upload as csv how can I do that.

import pandas as pd

# import json
import json
import boto3
# store the URL in url 

s3 = boto3.client('s3')

def lambda_handler(event, context):
    bucket ='aws-simplified-transactions420'
    url = 'https://house-stock-watcher-data.s3-us-west-2.amazonaws.com/data/all_transactions.json'
    df = pd.read_json(url)
    data = df.to_json()
    fileName = 'data' + '.json '
    uploadByteStream = bytes(json.dumps(data.encode='UTF-8'))
    s3.put_object(Bucket=bucket, Key=fileName, Body=uploadByteStream)
    print('Put Complete')

the error message

Response
{
  "errorMessage": "Syntax error in module 'lambda_function': keyword can't be an expression (lambda_function.py, line 16)",
  "errorType": "Runtime.UserCodeSyntaxError",
  "stackTrace": [
    "  File \"/var/task/lambda_function.py\" Line 16\n        uploadByteStream = bytes(json.dumps(data.encode='UTF-8'))\n"
  ]
}

How did it go? Still unclear what you can do?

Marcin
– Marcin

2022-01-17 05:41:50 +00:00
Commented Jan 17, 2022 at 5:41 — Marcin
– Marcin, Commented Jan 17, 2022 at 5:41

Marcin · Accepted Answer · 2022-01-11 06:47:15Z

1

Instead of

data.encode='UTF-8'

it should be:

data.encode('UTF-8')

answered Jan 11, 2022 at 6:47

Marcin

241k16 gold badges315 silver badges368 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

how to upload json to s3 with the help of lambda python?

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related