Python 3 - '_csv.Error: line contains NULL' error byte when reading csv file

Question

I'm trying to read a csv file that contains NUL with csv reader I search a lot for a way to read the file without an error and couldn't find one.

Edit: Adding the relevant section of the file: https://drive.google.com/open?id=1rtF3ck6QymtH4_n4iUjavPnxZiryq_Q4

My code:

   with codecs.open(log_path, 'r') as csv_file:
        log_reader = csv.DictReader(csv_file)
        for line in log_reader:
            if line['Addition Information'] == str 
               # do something

Will appreciate any help Thanks, Avishay

Can you post your CSV?

Rakesh
– Rakesh

2018-04-12 10:36:17 +00:00
Commented Apr 12, 2018 at 10:36 — Rakesh
– Rakesh, Commented Apr 12, 2018 at 10:36
I added a link to the relevant section

Avishay Cohen
– Avishay Cohen

2018-04-12 10:54:02 +00:00
Commented Apr 12, 2018 at 10:54 — Avishay Cohen
– Avishay Cohen, Commented Apr 12, 2018 at 10:54

mata · Accepted Answer · 2018-04-12 11:11:35Z

4

csv.reader() (and therefore also csv.DictReader()) simply can't deal with files containing null bytes.

A possible solution would be to replace null bytes when reading the input file, e.g. by using a generator expression, since reader() takes any object supporting the iterator protocol as argument:

with codecs.open(log_path, 'r') as csv_file:
    log_reader = csv.DictReader((l.replace('\0', '') for l in csv_file))
    for line in log_reader:
        if line['Addition Information'] == str 
           # do something

answered Apr 12, 2018 at 11:11

mata

69.3k10 gold badges168 silver badges162 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

Avishay Cohen Over a year ago

Working great! It's a little bit slower now but it's done the trick Thanks very much!

shey Over a year ago

this has worked for me too.Thanks and yes looks bit slow. but fine.

Denis Rasulev · Accepted Answer · 2018-04-12 11:17:00Z

0

Try to modify your code like this:

with codecs.open(log_path, 'r', encoding='utf-8', errors='backslashreplace') as csv_file:
        log_reader = csv.DictReader(csv_file)
        for line in log_reader:
            if line['Addition Information'] == str 
               # do something

answered Apr 12, 2018 at 11:17

Denis Rasulev

4,1295 gold badges39 silver badges54 bronze badges

Collectives™ on Stack Overflow

Python 3 - '_csv.Error: line contains NULL' error byte when reading csv file

2 Answers 2

2 Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

2 Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related