Python loop through URL's

Question

I'm attempting take dates from a dataframe and loop through them within URL's. I've managed to print the URL's (1st code), but when I attempt to turn the URL's json into a dataframe (2nd code) I get this response.

AttributeError: 'str' object has no attribute 'json'

#1st code
import requests
import pandas as pd

df = pd.read_csv('NBADates.csv')
df.to_dict('series')

for row in df.loc[ : ,"Date"]:
    url = url_template.format(row=row)
    print(url)

Any ideas on what I'm doing wrong?

#2nd code
import requests
import csv
import pandas as pd

url_template = "https://stats.nba.com/stats/leaguedashptstats?College=&Conference=&Country=&DateFrom={row}&DateTo={row}&Division=&DraftPick=&DraftYear=&GameScope=&Height=&LastNGames=0&LeagueID=00&Location=&Month=0&OpponentTeamID=0&Outcome=&PORound=0&PerMode=Totals&PlayerExperience=&PlayerOrTeam=Player&PlayerPosition=&PtMeasureType=SpeedDistance&Season=2017-18&SeasonSegment=&SeasonType=Regular+Season&StarterBench=&TeamID=0&VsConference=&VsDivision=&Weight="

df = pd.read_csv('NBADates.csv')
df.to_dict('series')

for row in df.loc[ : ,"Date"]:
    url = url_template.format(row=row)

    stats = url.json()['resultSets'][0]['rowSet']
    headers = url.json()['resultSets'][0]['headers']
    stats_df = pd.DataFrame(stats, columns=headers)

    # Append to the big dataframe
    lineup_df = lineup_df.append(stats_df, ignore_index=True)

lineup_df.to_csv("Stats.csv")

url in your code is a string. What is url.json() supposed to do? — user9455968
– user9455968, Commented Mar 18, 2018 at 19:34

rawwar · Accepted Answer · 2018-03-18 19:41:43Z

1

I think you forgot to request the URL. you should send a request and if the response is a json, you should parse it

answered Mar 18, 2018 at 19:41

rawwar

5,0909 gold badges38 silver badges62 bronze badges

Sign up to request clarification or add additional context in comments.

7 Comments

Nick Over a year ago

Oh wow thanks, I added in the request but now I'm getting this

Nick Over a year ago

json.decoder.JSONDecodeError: Expecting value: line 1 column 1 (char 0)

rawwar Over a year ago

can you give me a url, with row data fromatted into the string

Nick Over a year ago

stats.nba.com/stats/…

rawwar Over a year ago

looks like, sometimes nothing is being returned. check the following link , stackoverflow.com/questions/8381193/…

|

Collectives™ on Stack Overflow

Python loop through URL's

1 Answer 1

7 Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

7 Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related