3

Need to delete some specific column and rows(by index) of multiple csv files, without creating new files.

For the code below, it is giving output with new blank rows after each row.

import csv

with open('file.csv') as fd:
   reader = csv.reader(fd)
   valid_rows = [row for idx, row in enumerate(reader) if idx != 0]

with open('file.csv', 'w') as out:
   csv.writer(out).writerows(valid_rows)

What is the simpler way to do this(might be by other python libraries)?

5
  • can you also provide sample csv? Commented Nov 24, 2017 at 3:09
  • Possible duplicate of Deleting columns in a CSV with python Commented Nov 24, 2017 at 3:13
  • sample csv Commented Nov 24, 2017 at 3:15
  • @wp78de Need to delete column/row from source file, without creating new file. Commented Nov 24, 2017 at 3:22
  • But you write to file - it does not matter if it is the same or a new file. Commented Nov 24, 2017 at 3:28

1 Answer 1

6

Since you wish not to generate any new csv files and would like the data to perform operations, I would suggest you to make use of Pandas Framework. Make use of drop function in this framework.

Consider the following example:

Sample.csv:

col1,col2,col3,col4
1,2,3,4
5,6,7,8
9,10,11,12
13,14,15,16
17,18,19,20

Code:

import pandas as pd
df = pd.read_csv('./Sample.csv')

To delete columns:

df.drop('col3', axis = 1, inplace = True)

df contents:

   col1     col2    col4
0   1   2   4
1   5   6   8
2   9   10  12
3   13  14  16
4   17  18  20

To delete rows:

df.drop(df.index[[1,4]], inplace = True)

df contents:

   col1     col2    col4
0   1   2   4
2   9   10  12
3   13  14  16

Finally to save the edited csv file:

df.to_csv('new_sample.csv', index = False)
Sign up to request clarification or add additional context in comments.

4 Comments

Hi, this solution is for reading data only. I need to make the changes(deleting rows& columns) on the csv files also.
@ShailaZaman, make use of inplace option for that. I have edited the code. Check it out
Please can you elaborate where df is becoming None? The code I have given is a working example. (Check if you are not deleting all columns or rows by mistake)
That was a mistake by me. It is working. Thank you so much. Could you please edit your writing to csv line to the following line? df.to_csv('sample.csv', index=False) It was saving the csv with index of df.

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service and acknowledge you have read our privacy policy.

Start asking to get answers

Find the answer to your question by asking.

Ask question

Explore related questions

See similar questions with these tags.