I need a way to change the specific value of a column of a CSV file. For example I have this CSV file:
"Ip","Sites"
"127.0.0.1",10
"127.0.0.2",23
"127.0.0.3",50
and I need to change the value 23 to 30 of the row "127.0.0.2".
I use csv library: import csv
This is the solution opening the csv file, changing the values in memory and then writing back the changes to disk.
r = csv.reader(open('/tmp/test.csv')) # Here your csv file
lines = list(r)
Content of lines:
[['Ip', 'Sites'],
['127.0.0.1', '10'],
['127.0.0.2', '23'],
['127.0.0.3', '50']]
Modifying the values:
lines[2][1] = '30'
Content of lines:
[['Ip', 'Sites'],
['127.0.0.1', '10'],
['127.0.0.2', '30'],
['127.0.0.3', '50']]
Now we only have to write it back to a file
with open('/tmp/output.csv', 'w', newline='', encoding='utf-8') as file:
writer = csv.writer(file)
writer.writerows(lines)
writer = csv.writer(open('/tmp/output.csv', 'wb'))
You can use very powerful library called pandas. Here is the example.
import pandas as pd
df = pd.read_csv("test.csv")
df.head(3) #prints 3 heading rows
Output:
Ip Sites
0 127.0.0.1 10
1 127.0.0.2 23
2 127.0.0.3 50
Now if you want to change the value in the 'Sites' column in the 1st row, run:
df.set_value(1, "Sites", 30)
If you want to change all the values, where 'Ip' is equal to 127.0.0.2, run:
df.loc[df["Ip"]=="127.0.0.2", "Sites"] = 30
Finally, to save the values:
df.to_csv("test.csv", index=False)
PermissionError: [Errno 13] Permission denied: 'file.csv' Can you suspect what could be the reason?
You can't really replace values in the existing file. Instead, you need to:
What you can also do is read in the existing file line by line, writing it out to a new file, while replacing values on the fly. When done, close both files, delete the original and rename the new file.
An alternative to the accepted answer is to:
fileinput with inplace=True to modify the file in-placecsv.DictReader to access the column via header instead of indices (This only works if the CSV has headers)Test CSV:
Ip,Sites
127.0.0.1,10
127.0.0.2,23
127.0.0.3,50
Test Code:
import fileinput
with fileinput.input(files=('test.csv'), inplace=True, mode='r') as f:
reader = csv.DictReader(f)
print(",".join(reader.fieldnames)) # print back the headers
for row in reader:
if row["Ip"] == "127.0.0.2":
row["Sites"] = "30"
print(",".join([row["Ip"], row["Sites"]]))
The main difference is that you don't have to manually open the input file and create the output file, as inplace=True already does that behind-the-scenes:
Optional in-place filtering: if the keyword argument
inplace=Trueis passed tofileinput.input()or to theFileInputconstructor, the file is moved to a backup file and standard output is directed to the input file (if a file of the same name as the backup file already exists, it will be replaced silently). This makes it possible to write a filter that rewrites its input file in place.
The loop goes over the CSV row-by-row (except for the header row), so you can do whatever processing you need on each row.
If you still want to retain the original, you could pass in a backup=".backup" so that fileinput creates a test.csv.backup file.
Also, note that with in-place editing, "standard output is directed to the input file", so print(..) prints it out to the file instead of to the command line. If you want to actually print to the console, you need to specify stderr as in print(..., file=sys.stderr).