Python: Counting Zeros in multiple array columns and store them efficently

Question

I create an array:

import numpy as np
arr = [[0, 2, 3], [0, 1, 0], [0, 0, 1]]
arr = np.array(arr)

Now I count every zero per column and store it in a variable:

a = np.count_nonzero(arr[:,0]==0)
b = np.count_nonzero(arr[:,1]==0)
c = np.count_nonzero(arr[:,2]==0)

This code works fine. But in my case I have many more columns with over 70000 values in each. This would be many more lines of code and a very messy variable expolorer in spyder.

My questions:

Is there a possibility to make this code more efficient and save the values only in one type of data, e.g. a dictionary, dataframe or tuple?
Can I use a loop for creating the dic, dataframe or tuple?

Thank you

timgeb · Accepted Answer · 2020-06-24 07:38:44Z

5

You can construct a boolean array arr == 0 and then take its sum along the rows.

>>> (arr == 0).sum(0)
array([3, 1, 1])

answered Jun 24, 2020 at 7:38

timgeb

79.2k20 gold badges129 silver badges150 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

tstanisl · Accepted Answer · 2020-06-24 08:01:37Z

1

To count zeros you can count non-zeros along each column and subtract result from length of each column:

arr.shape[0] - np.count_nonzero(arr, axis=0)

produces [3,1,1].

This solution is very fast because no extra large objects are created.

answered Jun 24, 2020 at 8:01

tstanisl

14.3k3 gold badges31 silver badges45 bronze badges

1 Comment

hamflow Over a year ago

if axis or dimension of an array is not important, meaning you want to know total of nonzero elements, you can use: arr.size - np.count_nonzero(arr)

Gustav Rasmussen · Accepted Answer · 2020-06-24 07:44:27Z

0

Use an ordered dict from the collections module:

from collections import OrderedDict
import numpy as np
from pprint import pprint as pp
import string

arr = np.array([[0, 2, 3], [0, 1, 0], [0, 0, 1]])
letters = string.ascii_letters
od = OrderedDict()

for i in range(len(arr)):
    od[letters[i]] = np.count_nonzero(arr[:, i]==0)

pp(od)

Returning:

OrderedDict([('a', 3), ('b', 1), ('c', 1)])

Example usage:

print(f"First number of zeros: {od.get('a')}")

Will give you:

First number of zeros: 3

answered Jun 24, 2020 at 7:44

Gustav Rasmussen

4,0394 gold badges32 silver badges56 bronze badges

Collectives™ on Stack Overflow

Python: Counting Zeros in multiple array columns and store them efficently

3 Answers 3

Comments

1 Comment

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

Comments

1 Comment

Comments

Your Answer

Sign up or log in

Post as a guest

Related