How to extract the strings from csv file in python

Question

I am saving a csv file by reading my serial port. Few lines of my csv file:

*
20/01/20,10:13:59,"11   22
"
20/01/20,10:13:59,"11   22
"
20/01/20,10:13:59,"11   22
"
*

I would like to get the date, time and my 2 data all in a list as a[0] as date, a[1] as time, a[1]=data1, a[3]=data2

But I am not able to separate the 2 data, they come in the same column this is the code snippet

from pandas import read_csv

df = read_csv('test_csvtry1.csv')

output is:

A dataframe 7x3 but i want it as 7x4

"

1   20/01/20    10:13:59    "11 22
"

2   20/01/20    10:13:59    "11 22
"

3   20/01/20    10:13:59    "11 22
"

4   20/01/20    10:13:59    "11 22
"

5   20/01/20    10:13:59    "11 22
"

6   20/01/20    10:13:59    "11 22
"

Kindly can someone let me know how this can be done?

Could you please share some of the code you're using as well as the erroneous output you're receiving? — aargon
– aargon, Commented Jan 20, 2020 at 5:11
What is data1 and data 2? If they correspond to 11 and 12 in your data, they belong to the same cell in the csv which is why you the dataframe reads it as the same cell value. Are you generating this csv in previous code too? — Vishakha Lall
– Vishakha Lall, Commented Jan 20, 2020 at 5:21

Community · Accepted Answer · 2020-06-20 09:12:55Z

2

Why to use panda for something so basic?

import csv

with open("date_time_data.csv", 'r') as f:
    f_csv = csv.reader(f)
    for line in f_csv:
        a0, a1, a2 = line
        print(a0,a1,a2)

output

20/01/20 10:13:59 11   22

20/01/20 10:13:59 11   22

20/01/20 10:13:59 11   22

edited Jun 20, 2020 at 9:12

CommunityBot

11 silver badge

answered Jan 20, 2020 at 5:35

MasterOfTheHouse

1,3492 gold badges18 silver badges44 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

Vishakha Lall · Accepted Answer · 2020-01-20 05:36:59Z

0

To split the data1 and data2 in the read_csv function itself, here's what you could do.

from pandas import read_csv

df = read_csv('test_csvtry1.csv', header=None, delim_whitespace=True)

This would give you the 7x4 dataframe, you're looking for.

edited Jan 20, 2020 at 5:36

answered Jan 20, 2020 at 5:26

Vishakha Lall

1,34418 silver badges36 bronze badges

Comments

Prashant Kumar · Accepted Answer · 2020-01-20 06:18:05Z

You need to split the data part using the delimiter between data1 and data2.

In this case the delimiter is space.

Get you concatenated data into some variable and do below split operation.

splitdata = data.split(" ")
data1, data2 = splitdata[0], splitdata[1]

While reading the CSV you will always get it in same column. You need to split and store in different column manually.

Create an empty column into your dataframe.

df['data2'] = np.nan

Now,

Iterate over your dataframe and pick the data value.
Split the data value using above method and replace current data value with data1.
Store data2 into the newly created column.

Hope this should solve your problem.

for row in df.itertuples():
    data = row.data
    splitdata = data.split(" ")
    data1, data2 = splitdata[0], splitdata[1]
    row.data = data1
    row.data2 = data2

Shahir Ansari · Accepted Answer · 2020-02-26 11:11:58Z

0

Use multiple seperators while reading the csv file seperators being ["] , [,] ,and [ ]

df = pd.read_csv("test_csvtry1.csv" , sep='"|,| ', header = None)

df

0   0   20/01/20    10:13:59    NaN   11    22
1   1   20/01/20    10:13:59    NaN   11    22
2   2   20/01/20    10:13:59    NaN   11    22

Drop the column with Nan values.

edited Feb 26, 2020 at 11:11

answered Jan 20, 2020 at 5:55

Shahir Ansari

1,86818 silver badges21 bronze badges

Collectives™ on Stack Overflow

How to extract the strings from csv file in python

4 Answers 4

output

Comments

Comments

Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

4 Answers 4

output

Comments

Comments

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related