I must pass two-dimensional input. Three-dimensional list to dataframe (Python)

Question

I'm web scraping data and want to put it into a data frame for analysis.

I have a three-dimensional list that comes out of my scrape and I can't figure out how to get it into a data frame. I know I need to make it two-dimensional (249, 4) from the three-dimensional list (1, 249, 4).

table_countryCodes = pd.read_html("https://www.iban.com/country-codes")
np.reshape(table_countryCodes, (249,4))
df_countryCodes = pd.DataFrame(table_countryCodes)
print(df_countryCodes)

Error: ValueError: Must pass 2-d input. shape=(1, 249, 4)

How can I fix this?

Here is a sample of the three-dimensional list from the web scrape for context:

Country            Alpha-2 code   Alpha-3 code   Numeric
American Samoa        AS             ASM            16
Andorra               AD             AND            20
Angola                AO             AGO            24
Anguilla              AI             AIA            660

Does this answer your question? numpy with python: convert 3d array to 2d — Himanshu Poddar
– Himanshu Poddar, Commented Jul 11, 2022 at 4:59
I try running that but I get an error when using the transpose function "'list' object has no attribute 'transpose'" — Jordan
– Jordan, Commented Jul 11, 2022 at 5:02
Okay, then how do I convert from 2d array to dataframe? I thought pd.dataframe would do it no? — Jordan
– Jordan, Commented Jul 11, 2022 at 5:21

Peter Mortensen · Accepted Answer · 2022-07-11 13:25:38Z

1

pd.read_html reads all HTML tables into a list of DataFrame objects. Since your use case has only one table in the page, you can extract the same using

df = table_countryCodes[0]
print(df)

which gives us

               Country Alpha-2 code Alpha-3 code  Numeric
0          Afghanistan           AF          AFG        4
1        Åland Islands           AX          ALA      248
2              Albania           AL          ALB        8
3              Algeria           DZ          DZA       12
4       American Samoa           AS          ASM       16
..                 ...          ...          ...      ...
244  Wallis and Futuna           WF          WLF      876
245     Western Sahara           EH          ESH      732
246              Yemen           YE          YEM      887
247             Zambia           ZM          ZMB      894
248           Zimbabwe           ZW          ZWE      716

[249 rows x 4 columns]

edited Jul 11, 2022 at 13:25

Peter Mortensen

31.4k22 gold badges110 silver badges134 bronze badges

answered Jul 11, 2022 at 5:33

Himanshu Poddar

7,90116 gold badges60 silver badges120 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Grismar · Accepted Answer · 2022-07-11 05:33:23Z

1

You simply need:

pd.DataFrame(table_countryCodes[0])

i.e. add [0] to select the first and only element in table_countryCodes, which has the shape you need.

answered Jul 11, 2022 at 5:33

Grismar

32.4k6 gold badges42 silver badges68 bronze badges

Collectives™ on Stack Overflow

I must pass two-dimensional input. Three-dimensional list to dataframe (Python)

2 Answers 2

Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related