Reshape pandas columns into numpy arrays

Question

I have a very long dataframe with many columns of the form k1, p1, k2, p2,...,kn, pn such as

       k1         p1           k2             p2           k3         p3 ...    
-0.001870   0.000659    -0.005000       0.000795    -0.003889   0.000795 ...
-0.002778   0.000556     0.000795       0.001667     0.000795   0.002778 ...

How could I build, in the most pythonic way, a numpy array with the k's and p's separated into arrays, like [[[-0.001870,-0.005000,-0.003889,...],[0.000659,0.000795,0.000795...]],[[-0.002778, 0.000795, 0.000795...],[0.000556, 0.001667, 0.002778...]], ...[[...],[...]]]

mozway · Accepted Answer · 2023-02-13 14:29:07Z

2

Convert to_numpy and reshape:

out = df.to_numpy().reshape((len(df), 2, -1), order='F')

Output:

array([[[-0.00187 , -0.005   , -0.003889],
        [ 0.000659,  0.000795,  0.000795]],

       [[-0.002778,  0.000795,  0.000795],
        [ 0.000556,  0.001667,  0.002778]]])

answered Feb 13, 2023 at 14:29

mozway

267k13 gold badges56 silver badges106 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Yilun Zhang · Accepted Answer · 2023-02-13 14:33:11Z

1

It seems that in your case the columns are alternating between k and p but just in case it's not always the case, you can do:

k_matrix = df[[c for c in df.columns if c.startswith("k")]].to_numpy()
p_matrix = df[[c for c in df.columns if c.startswith("p")]].to_numpy()

answered Feb 13, 2023 at 14:33

Yilun Zhang

9,0685 gold badges35 silver badges68 bronze badges

Collectives™ on Stack Overflow

Reshape pandas columns into numpy arrays

2 Answers 2

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related