pandas: convert multiple columns to string

Question

I have some columns ['a', 'b', 'c', etc.] (a and c are float64 while b is object)

I would like to convert all columns to string and preserve nans.

Tried using df[['a', 'b', 'c']] == df[['a', 'b', 'c']].astype(str) but that left blanks for the float64 columns.

Currently I am going through one by one with the following:

df['a'] = df['a'].apply(str)
df['a'] = df['a'].replace('nan', np.nan)

Is the best way to use .astype(str) and then replace '' with np.nan? Side question: is there a difference between .astype(str) and .apply(str)?

Sample Input: (dtypes: a=float64, b=object, c=float64)

a, b, c, etc.
23, 'a42', 142, etc.
51, '3', 12, etc.
NaN, NaN, NaN, etc.
24, 'a1', NaN, etc.

Desired output: (dtypes: a=object, b=object, c=object)

a, b, c, etc.
'23', 'a42', '142', etc.
'51', 'a3', '12', etc.
NaN, NaN, NaN, etc.
'24', 'a1', NaN, etc.

can you post sample input and desired output data sets?

MaxU - stand with Ukraine
– MaxU - stand with Ukraine

2016-05-04 18:25:12 +00:00
Commented May 4, 2016 at 18:25 — MaxU - stand with Ukraine
– MaxU - stand with Ukraine, Commented May 4, 2016 at 18:25
@Maxu for sure, I updated the question

As3adTintin
– As3adTintin

2016-05-04 18:29:57 +00:00
Commented May 4, 2016 at 18:29 — As3adTintin
– As3adTintin, Commented May 4, 2016 at 18:29

Andreas · Accepted Answer · 2019-05-17 01:49:56Z

7

This gives you the list of column names

lst = list(df)

This converts all the columns to string type

df[lst] = df[lst].astype(str)

edited May 17, 2019 at 1:49

Andreas

2,52110 gold badges24 silver badges25 bronze badges

answered May 17, 2019 at 0:08

Raj

6334 gold badges18 silver badges32 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Alexander · Accepted Answer · 2016-05-04 19:14:46Z

4

df = pd.DataFrame({
    'a': [23.0, 51.0, np.nan, 24.0],
    'b': ["a42", "3", np.nan, "a1"],
    'c': [142.0, 12.0, np.nan, np.nan]})

for col in df:
    df[col] = [np.nan if (not isinstance(val, str) and np.isnan(val)) else 
               (val if isinstance(val, str) else str(int(val))) 
               for val in df[col].tolist()]

>>> df
     a    b    c
0   23  a42  142
1   51    3   12
2  NaN  NaN  NaN
3   24   a1  NaN

>>> df.values
array([['23', 'a42', '142'],
       ['51', '3', '12'],
       [nan, nan, nan],
       ['24', 'a1', nan]], dtype=object)

edited May 4, 2016 at 19:14

answered May 4, 2016 at 18:58

Alexander

111k32 gold badges212 silver badges208 bronze badges

2 Comments

As3adTintin Over a year ago

thanks! so that basically goes through each column, and leaves a np.nan if it is not a string and missing, and otherwise converts the value to string (if i am correct). great! do you know how to get rid of the .0s too?

Alexander Over a year ago

The columns are converted to floats because of the np.nan. I'll add something to convert to ints.

marc_s · Accepted Answer · 2018-11-08 21:47:41Z

3

You could apply .astype() function on every elements of dataframe, or could select the column of interest to convert to string by following ways too.

In [41]: df1 = pd.DataFrame({
    ...:     'a': [23.0, 51.0, np.nan, 24.0],
    ...:     'b': ["a42", "3", np.nan, "a1"],
    ...:     'c': [142.0, 12.0, np.nan, np.nan]})
    ...: 

In [42]: 

In [42]: df1
Out[42]: 
      a    b      c
0  23.0  a42  142.0
1  51.0    3   12.0
2   NaN  NaN    NaN
3  24.0   a1    NaN

### Shows current data type of the columns:
In [43]: df1.dtypes
Out[43]: 
a    float64
b     object
c    float64
dtype: object

### Applying .astype() on each element of the dataframe converts the datatype to string
In [45]: df1.astype(str).dtypes
Out[45]: 
a    object
b    object
c    object
dtype: object

### Or, you could select the column of interest to convert it to strings
In [48]: df1[["a", "b", "c"]] = df1[["a","b", "c"]].astype(str)

In [49]: df1.dtypes ### Datatype update
Out[49]: 
a    object
b    object
c    object
dtype: object

edited Nov 8, 2018 at 21:47

marc_s

760k186 gold badges1.4k silver badges1.5k bronze badges

answered Aug 23, 2017 at 21:12

Surya Chhetri

11.7k4 gold badges61 silver badges39 bronze badges

1 Comment

Brainless Over a year ago

Why does df1.astype(str).dtypes show only object types?

ahmad fairuz · Accepted Answer · 2017-05-19 16:14:09Z

0

I did this way.

get all your value from a specific column, e.g. 'text'.

k = df['text'].values

then, run each value into a new declared string, e.g. 'thestring'

thestring = ""
for i in range(0,len(k)):
    thestring += k[i]
print(thestring)

hence, all string in column pandas 'text' has been put into one string variable.

cheers, fairuz

answered May 19, 2017 at 16:14

ahmad fairuz

314 bronze badges

Collectives™ on Stack Overflow

pandas: convert multiple columns to string

4 Answers 4

Comments

2 Comments

1 Comment

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

4 Answers 4

Comments

2 Comments

1 Comment

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related