Read a csv file in python correctly using pandas [duplicate]

Question

I am trying to read this file using read_csv in pandas(python). But I am not able to capture all columns. Can you help?

Here is the code:

file = r'path of file'
df = pd.read_csv(file, encoding='cp1252', on_bad_lines='skip')

What exactly do you mean by "not able to capture all columns"? What's the expected result? What result are you actually getting? What's the difference between the two? — ForceBru
– ForceBru, Commented Sep 19, 2022 at 11:11
if you open the file in excel or notepad++ you will see that there are 161 columsn and the code can capture only 7 — rish
– rish, Commented Sep 19, 2022 at 11:15

inarighas · Accepted Answer · 2022-09-19 11:34:31Z

1

I tried to read your file, and I first noticed that the encoding you specified does not correspond to the one used in your file. I also noticed that the separator is not a comma (,) but a tab (\t).

First, to get the file encoding (in linux), you just need to run:

$ file -i kopie.csv 
kopie.csv: text/plain; charset=utf-16le

In Python:

import pandas as pd

path_to_file = 'kopie.csv'
df = pd.read_csv(path_to_file, encoding='utf-16le', sep='\t')

And when I print the shape of the loaded dataframe:

>>> df.shape
(869, 161)

answered Sep 19, 2022 at 11:34

inarighas

8698 silver badges26 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

rish Over a year ago

how to find the encoding in windows?

inarighas Over a year ago

it is less obvious, check this SO page: stackoverflow.com/questions/3710374/…

Collectives™ on Stack Overflow

Read a csv file in python correctly using pandas [duplicate]

1 Answer 1

2 Comments

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Linked

Related