Passing Lambda Variable to Glue Script AWS

Question

I have a lambda function that looks like this:

client = boto3.client('glue')

glueJobName = "Python Glue Script"
inputtedData = "A1B2C3D4E5"
school = "testing"

def lambda_handler(event, context):
    response = client.start_job_run(JobName = glueJobName, Arguments = {'==inputtedData': inputtedData, '--school': school})
    return response

This starts running my glue job which contains a script. However, I want to pass the Arguments 'inputtedData' and 'school' to this script, so that when the script starts, these variables will be inputted into my syncData function like this:

def syncAttendance(inputtedData, school):

   schoolName = school
   Data = inputtedData
   print(schoolName, Data)


syncData(inputtedData, school)

How do I receive these variables in the glue script?

Note the typo in your '==inputtedData'

taras
– taras

2020-11-27 12:44:51 +00:00
Commented Nov 27, 2020 at 12:44 — taras
– taras, Commented Nov 27, 2020 at 12:44

taras · Accepted Answer · 2020-11-27 12:44:21Z

2

You need to use getResolvedOptions function as follows:

import sys
from awsglue.utils import getResolvedOptions

options = ['inputtedData', 'school']
args = getResolvedOptions(sys.argv, options)

syncData(args['inputtedData'], args['school'])

answered Nov 27, 2020 at 12:44

taras

6,93510 gold badges46 silver badges54 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

user14619141 Over a year ago

Thanks, do I put this at the top of the python glue job script?

taras Over a year ago

It doesn't matter where you put args = getResolvedOptions(sys.argv, options). It just needs to be executed before you call your syncData

Collectives™ on Stack Overflow

Passing Lambda Variable to Glue Script AWS

1 Answer 1

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related