Numpy mask input data with missing values

Question

I'm loading data from a csv using loadtxt where all values are floats with the exception of missing data which is coded as the character "?".

I'm trying to create a masked array such that I can use np.ma functions on the loaded data where the missing data will be ignored for the purpose of averages, etc. I've read the documentation for masked_array and this is probably incredibly trivial but I can't seem to figure out how to mask the array such that ? are ignored for the purpose of np.ma mathematical functions.

Saullo G. P. Castro · Accepted Answer · 2014-05-08 07:04:50Z

3

You can simply use np.genfromtxt() to read the files and mask the resulting nan values. For example:

input:

11, 12, 13, ?, ?, 16
21, 22, ?, 24, ?, 26

code:

a = np.genfromtxt('test.txt', delimiter=',', missing_values='?', usemask=True)

a.sum(axis=1).data
#array([ 52.,  93.])

a.mean()
#18.125

edited May 8, 2014 at 7:04

answered May 8, 2014 at 6:59

Saullo G. P. Castro

59.4k28 gold badges191 silver badges244 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Numpy mask input data with missing values

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related