dict to json over loop python

Question

I'm using Twitter's streaming api to extract tweets using Tweepy and write them to a json file. So far, i've extracted the tweets successfully and wrote them to a json file using file write but when i try to use json package i get error as mentioned in the code below.

 def on_data(self, data):
    #to convert data to dict format since twitter data is in string format
    json_data = json.loads(data)
    try:
        with open('twitter_data.json','ab') as f:
                if 'limit' in json_data.keys():
                    return True
                else:
                    #This method works
                    #f.write(json.dumps(json_data)+ "\n")
                    #this one does not as it concatenates dict i.e different dict are not separated by a comma
                    json.dump(json_data,f)
                    return True
    except BaseException as e:
        print e
        logging.debug('Error %s',e)
        return True

tdelaney · Accepted Answer · 2016-02-09 02:20:24Z

1

You get the right data but don't have the line separator... so add it yourself

import json
with open('deleteme', 'a') as fp:
    json.dump('data', fp)
    fp.write('\n')

answered Feb 9, 2016 at 2:20

tdelaney

77.9k6 gold badges91 silver badges129 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

dict to json over loop python

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related