How to remove accents from strings using Python (encoding parameter)?

Question

I'm trying to remove accents from data in a csv file. So I use the remove_accents function (See below) but for that I need to encode my csv files in utf-8. But I've got the error 'encoding' is an invalid keyword argument for this function
I've seen that I may have to use Python3 and then execute python3 ./myscript.py? Is this the right way to do it ? Or is there another way to remove accents wihtout having to install python3 ? Any help would be much appreciated

 #!/usr/bin/env python

import re
import string
import csv
import unicodedata

def remove_accents(data):
    return ''.join(x for x in unicodedata.normalize('NFKD', data) if \
    unicodedata.category(x)[0] == 'L').lower()


reader=csv.reader(open('infile.csv', 'r', encoding='utf-8'), delimiter='\t')
writer=csv.writer(open('outfile.csv', 'w', encoding='utf-8'), delimiter=',')

for line in reader:
    if line[0] != '':
        person=re.split(' ',line[0])

        first_name = person[0].strip().upper()
        first_name1=unicode(first_name)
        first_name2=remove_accents(first_name1)
        if len(person) == 2:
            last_name=person[1].strip().upper()
            line[0]=last_name
        line[15]=first_name2

    writer.writerow(line)

Seems like a duplicate of stackoverflow.com/questions/517923/… — Gilles Quénot
– Gilles Quénot, Commented Oct 7, 2012 at 15:06

Ignacio Vazquez-Abrams · Accepted Answer · 2012-10-07 15:03:05Z

1

You need to use codecs.open() if you want to be able to specify an encoding. Also, unidecode.

answered Oct 7, 2012 at 15:03

Ignacio Vazquez-Abrams

804k160 gold badges1.4k silver badges1.4k bronze badges

Sign up to request clarification or add additional context in comments.

1 Comment

Reveclair Over a year ago

(thanks for answering)I've now the following error : UnicodeEncodeError: 'ascii' codec can't encode character u'\xa0' in position 24: ordinal not in range(128)

Collectives™ on Stack Overflow

How to remove accents from strings using Python (encoding parameter)?

1 Answer 1

1 Comment

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

1 Comment

Your Answer

Sign up or log in

Post as a guest

Linked

Related