Loop over a list in python and create a dataframe

Question

I have a list "profiles" looking like this for each element of the list: enter image description here

I want to create a dataframe out of this list, so that every account is in the dataframe. When I create one dataframe for every element of the list manually and then append them all to one dataframe it works. However, I wanted to do a loop because I have about 40 elements in that list.

The code looks as follows (doing it manually):

df2 = pd.DataFrame(profiles[1])
df1 = df1.append(df2)
df3 = pd.DataFrame(profiles[2])
df1 = df1.append(df3)
... and so on

My loop looks like this:

   for y in range(len(profiles)):
        if x != y:
            df1 = pd.DataFrame(profiles[x])
            df2 = pd.DataFrame(profiles[y])
            df1.append(df2)

Does anybody know how to make the loop work? Because it does not append the second dataframe.

some links for reference stackoverflow.com/help/how-to-ask, and stackoverflow.com/help/minimal-reproducible-example — Naveed
– Naveed, Commented Jun 11, 2022 at 13:29
Just a friendly reminder, df.append is deprecated from version 1.4.0, so it's better to use df.concatenate. Also, if possible, please add a data sample for us to try out and your exptected output. Thank you. — user16836078
– user16836078, Commented Jun 11, 2022 at 15:43

Naveed · Accepted Answer · 2022-06-11 13:37:15Z

1

you are overwriting your df1 in each iteration of the loop

IIUC, In the absence of the reproducible data and example, this is what you should add to your code

outside of the for loop, create an empty dataframe

df_final = pd.DataFrame()

inside the loop

df_final = pd.concat([df_final, df1], axis=1)

if your df1 and df2 both gets initialized in each iteration, then you can add them both to the df_final together as follows

df_final = pd.concat([df_final, df1, df2], axis=1)

at the end of the loop df_final will have all the df's appended to it

edited Jun 11, 2022 at 13:37

answered Jun 11, 2022 at 13:28

Naveed

11.7k2 gold badges16 silver badges21 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Ronald Ryuu · Accepted Answer · 2022-06-11 13:27:47Z

0

append is not an inPlace Operation, so you have to assign the result of the function (otherwise it gets lost)

answered Jun 11, 2022 at 13:27

Ronald Ryuu

1

1 Comment

Community Over a year ago

As it’s currently written, your answer is unclear. Please edit to add additional details that will help others understand how this addresses the question asked. You can find more information on how to write good answers in the help center.

Collectives™ on Stack Overflow

Loop over a list in python and create a dataframe

2 Answers 2

Comments

1 Comment

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

1 Comment

Your Answer

Sign up or log in

Post as a guest

Related