Python Json - KeyError

Question

I am trying to retrieve the records from an API and eventually want to store them in a dataframe so that I can do some analytics. But I am getting the following error:

  for item in json_obj["records"]:
KeyError: 'records'

Code:

import urllib.request
import json

import urllib.request
url = 'https://eservices.mas.gov.sg/api/action/datastore/search.json?resource_id=7f1363cc-3875-4e03-a389-fc47342bb840&limit=5'

response = urllib.request.urlopen(url).read().decode('UTF-8')
json_obj = json.loads(response)

for item in json_obj["records"]:
    print(item[end_of_month'])
    print(item['preliminary'])
    print(item['cards_main'])

OK, so there isn't a 'records' key in the json_obj dictionary. Beyond that, what do you think anyone can tell you? Do you know what keys it does have? Have you tried printing them out? Doing any other debugging? — jonrsharpe
– jonrsharpe, Commented Feb 27, 2017 at 22:34
As jonrsharpe said, take a look at what keys there actually are: console.log(Object.keys(json_obj)) should make it easy to see. — Richard Dunn
– Richard Dunn, Commented Feb 27, 2017 at 22:41
Peeking at the data, you want json_obj["result"]["records"] — tdelaney
– tdelaney, Commented Feb 27, 2017 at 22:43
@jonrsharpe oh dear. That's what working in both all day and then staying up late gets me. print(json_obj.keys()) in that case... Or better still, what I use to explore data in python: from pprint import pprint then simply pprint(json_obj) — Richard Dunn
– Richard Dunn, Commented Feb 28, 2017 at 11:27

Serge Ballesta · Accepted Answer · 2017-02-27 22:43:41Z

1

When you cannot find a key where the API doc says that it should be there, you should just print the text of the json, because it is a text format.

Here, it would be evident that the records key does exist but is not a top level one but a sub-key of result.

Your code should be:

for item in json_obj["result"]["records"]:
    print(item['end_of_month'])
    print(item['preliminary'])
    print(item['cards_main'])

answered Feb 27, 2017 at 22:43

Serge Ballesta

150k13 gold badges137 silver badges267 bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

user7632376 Over a year ago

Thank you Serge. This solved the problem. I didn't know that I have to use ["result"]["records"] instead of just ["records"]

Collectives™ on Stack Overflow

Python Json - KeyError

1 Answer 1

1 Comment

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

1 Comment

Your Answer

Sign up or log in

Post as a guest

Related