python unable to parse JSON Data

Question

I am unable to parse the JSON data using python.

A webpage url is returning JSON Data

import requests
import json  

BASE_URL = "https://www.codechef.com/api/ratings/all"
data = {'page': page, 'sortBy':'global_rank', 'order':'asc', 'itemsPerPage':'40' }
r = requests.get(BASE_URL, data = data)
receivedData = (r.text)
print ((receivedData))

when I printed this, I got large text and when I validated using https://jsonlint.com/ it showed VALID JSON

Later I used

import requests
import json    

BASE_URL = "https://www.codechef.com/api/ratings/all"
data = {'page': page, 'sortBy':'global_rank', 'order':'asc', 'itemsPerPage':'40' }
r = requests.get(BASE_URL, data = data)
receivedData = (r.text)
print (json.loads(receivedData))

When I validated the large printed text using https://jsonlint.com/ it showed INVALID JSON

Even if I don't print and directly use the data. It is working properly. So I am sure even internally it is not loading correctly.

is python unable to parse the text to JSON properly?

You decoded the JSON and printed a text representation of a Python dictionary, which is not necessarily the same as the original JSON encoding. — chepner
– chepner, Commented May 5, 2017 at 13:07
The fact that you are getting any output from your second script is proof that Python is parsing the JSON just fine; you just aren't outputting JSON to the validator. — chepner
– chepner, Commented May 5, 2017 at 13:08
Even if I don't print and directly use the data. It is working properly. So I am sure even internally it is not loading correctly. — Rahul Kumar
– Rahul Kumar, Commented May 5, 2017 at 13:13

Jmons · Accepted Answer · 2017-05-05 13:11:18Z

1

in short, json.loads converts from a Json (thing, objcet, array, whatever) into a Python object - in this case, a Json Dictionary. When you print that, it will print as a itterative and therefore print with single quotes..

Effectively your code can be expanded:

some_dictionary = json.loads(a_string_which_is_a_json_object)
print(some_dictionary)

to make sure that you're printing json-safe, you would need to re-encode with json.dumps

answered May 5, 2017 at 13:11

Jmons

1,81618 silver badges28 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

dvdnglnd · Accepted Answer · 2017-05-05 13:15:21Z

1

When you use python's json.loads(text) it returns a python dictionary. When you print that dictionary out it is not in json format.

If you want a json output you should use json.dumps(json_object).

answered May 5, 2017 at 13:15

dvdnglnd

811 silver badge3 bronze badges

Collectives™ on Stack Overflow

python unable to parse JSON Data

2 Answers 2

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related