For loop json files in Python

Question

I have 10 json files called Herald500_2005, Herald500_2006.... Herald500_2015. I am trying to carry the same search of keywordswords in each file. Instead of doing it one by one I would like to be able to do it in a loop. So far I have tried the following code:

for i in range(5,15):
    df = pandas.DataFrame([json.loads(l) for l in open('Herald500_200i.json')])
# Parse dates and set index
    df.date = pandas.to_datetime(df.date)
    df.set_index('date', inplace=True)
# match keywords
    matchingbodies = df[df.body.str.contains("|".join(keywords3))&df.body.str.contains("|".join(keywords2))&df.body.str.contains("|".join(keywords1))].body
# Count by month
    counts = matchingbodies.groupby(lambda x: x.month).agg(len)

    print "TH 200i" 
    print counts

By running this code I am getting the following error:

<ipython-input-9-76f2d2649df0> in <module>()
      1 for i in range(5,15):
----> 2     df = pandas.DataFrame([json.loads(l) for l in open('Herald500_200i.json')])
      3 # Parse dates and set index
      4     df.date = pandas.to_datetime(df.date)
      5     df.set_index('date', inplace=True)

IOError: [Errno 2] No such file or directory: 'Herald500_200i.json'

Any idea how to correct the code?

Kind regards

You have 11 files, not 10.

Open AI - Opting Out
– Open AI - Opting Out

2016-03-14 16:32:34 +00:00
Commented Mar 14, 2016 at 16:32 — Open AI - Opting Out
– Open AI - Opting Out, Commented Mar 14, 2016 at 16:32

alecxe · Accepted Answer · 2016-03-14 16:31:56Z

8

You should use string formatting to get the i value into the string:

open('Herald500_200%d.json' % i)

Or:

open('Herald500_200{0}.json'.format(i))

Or, since these are years and to simplify handling the leading zero formatting problem, just loop over the years directly:

for year in range(2005, 2016):  # note the 2016 here - the upper bound is non-inclusive
    df = pandas.DataFrame([json.loads(l) for l in open('Herald500_%d.json' % year)])

edited Mar 14, 2016 at 16:31

answered Mar 14, 2016 at 16:19

alecxe

476k127 gold badges1.1k silver badges1.2k bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

Economist_Ayahuasca Over a year ago

Works excelent, but the only problem is that when reaching to 2010, it tries to get 20010, I guess I could fix it with for i in range(05,15) and open('Herald500_20%d.json' % i)

Economist_Ayahuasca Over a year ago

Works great @alecxe!

Collectives™ on Stack Overflow

For loop json files in Python

1 Answer 1

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related