Conversion between Json and DataFrame using Python

Question

I have the following code:

responsedata = requests.get(url, data=data, headers=hed, verify=False)
sample_object = pd.DataFrame(responsedata.json())['results'].to_dict()
func(sample_object)

Now, I have another get call using function which does some manipulation over the data:

responsedata2 = get_data(url2)

I do know that:

responsedata2 is equivalent to responsedata.json()['results']

as if I do:

print responsedata2  
print responsedata.json()['results']

I will get the same output (If called with the same URL).

My question is how can I create sample_object2 that will be equivalent to sample_object1 so I will be able to do: func(sample_object2)

Any idea how to make it works? It seems simply but the involvement of the DataFrame makes it hard.

Edit:

To explain better what I'm after. I want to write a function that gets object like responsedata2 and return object like sample_object.

Can you provide some example data, and some more information on what func() and getdata() do? At present it's not very clear where your problem is. — asongtoruin
– asongtoruin, Commented Aug 6, 2018 at 10:05
@asongtoruin tried that before stackoverflow.com/questions/51692872/… it got people confuse. Here I'm looking for something simpler... Just convert types. Take responsedata2 and convert it to sample_object When the information you know is that responsedata2 is the same as responsedata.json()['results'] — Programmer120
– Programmer120, Commented Aug 6, 2018 at 10:10
Could you please give an example of the input data and the corresponding output you expect ? — joaquin
– joaquin, Commented Aug 6, 2018 at 10:12
@joaquin responsedata Is a {Response} <Response [200]> object it gives: textuploader.com/dz3u0 sample_object is a dictionary as: textuploader.com/dz3uj This conversion is done by my code successfuly. responsedata2 is textuploader.com/dz3ux — Programmer120
– Programmer120, Commented Aug 6, 2018 at 11:01

Alexander Lupas · Accepted Answer · 2018-08-06 13:16:24Z

1

From what I can tell pd.DataFrame(responsedata.json())['results'].to_dict()

gives you {0: (first data set), 1: (second data set)},

while responsedata.json()['results']

gives you a list of [(first data set), (second data set)].

In order to turn the list into a dictionary like the first, use

sample_object = {i: data for i, data in enumerate(responsedata2)}

enumerate is a generator that takes an iterable such as ['a', 'b', 'c', ...] and returns tuples (0, 'a'), (1, 'b'), etc.

edited Aug 6, 2018 at 13:16

answered Aug 6, 2018 at 12:04

Alexander Lupas

613 bronze badges

Sign up to request clarification or add additional context in comments.

4 Comments

Programmer120 Over a year ago

Are you referring to : temp = {i: data for i, data in enumerate(responsedata2 )} sample_object = pd.DataFrame(temp).to_dict() ?

Alexander Lupas Over a year ago

No, just sample_object = {i: data for i, data in enumerate(responsedata2)} ought to give you the {0: (first data set), 1: (second data set)} dict that I think you want. Trying to pass that into DataFrame should fail anyway.

Programmer120 Over a year ago

I used what I wrote and it worked. Then I removed the 2nd row and it worked either :) not sure what's going on I'm just glad it's working. If you can explain it that would be awesome

Alexander Lupas Over a year ago

Huh, then again I don't have a lot of experience with pandas. I think what it's doing is just taking the dict, turning it into a DataFrame, then turning it right back into a dict. Sort of what happens if you write int(str(2)).

Collectives™ on Stack Overflow

Conversion between Json and DataFrame using Python

1 Answer 1

4 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

4 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related