Using a schema stored in a JSON file in Python

Question

As to Google documents I can use the schema stored in a JSON file in command line as the following:

bq --location=location load \
--source_format=format \
project_id:dataset.table \
path_to_data_file \
path_to_schema_file

where path_to_schema_file is the path to the file that contains the schema

is there a way to do this in python and pass the schema from the json file to the LoadJobConfig().schema ? or I should read the schema manually and transform it into bigquery.TableSchema() object?

Er... · Accepted Answer · 2019-12-17 08:56:56Z

3

schema_from_json() seems to be what you're looking for.

It converts a file in json format to a list of schema properties (which seems to be what you need for LoadJobConfig().schema)

answered Dec 17, 2019 at 8:56

Er...

6736 silver badges13 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

m0etaz · Accepted Answer · 2019-12-17 09:10:24Z

0

did you try initializing the LoadJobConfig with the schema ?

e.g.:

with open('path_to_schema_file') as json_file:
    schema = json.load(json_file)
    LoadJobConfig(schema=schema)

answered Dec 17, 2019 at 9:10

m0etaz

1,0031 gold badge9 silver badges21 bronze badges

2 Comments

Joe Over a year ago

actually this didn't work as LoadJobConfig.schema only takes list of SchemaFields() and doesn't take json

m0etaz Over a year ago

I thought it accepts a dict, because according to the docs , the type of schema can be a sequence of mappings

Collectives™ on Stack Overflow

Using a schema stored in a JSON file in Python

2 Answers 2

Comments

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related