With smaller numbers your method works:
In [20]: a=[[10 for i in range(1000)] for j in range(1000)]
In [21]: M=sparse.csr_matrix(a)
In [22]: M
Out[22]:
<1000x1000 sparse matrix of type '<class 'numpy.int32'>'
with 1000000 stored elements in Compressed Sparse Row format>
Density is not the issue. Size probably is. I can't reproduce your error because when I try larger sizes my machine slows to a crawl and I have to interrupt the process.
As given in the documentation, csr_matrix takes several kinds of input. It recognizes them based on the number of elements. I'd have to look at the code to remember the exact logic. But one method expects a tuple of 3 arrays or lists, another a tupe of 2 items, with the second being another tuple. The third is a numpy array. Your case, a list of lists doesn't fit any of those, but it probably trys to turn it into an array.
a = np.array([[10 for i in range(M)] for j in range(N)])
Most likely your error message is the result of some sort memory error - you are trying to make too large of a matrix. A dense matrix 70000 square is big (at least on some machines) and a sparse one representing the same matrix will be even larger. It has to store each of the elements 3 times - once for value, and twice for coordinates.
A truely sparse matrix of that size works because the sparse representation is much smaller, roughly proportional to 3x the number of nonzero elements.
In scipy/sparse/compressed.py
class _cs_matrix(...):
"""base matrix class for compressed row and column oriented matrices"""
def __init__(self, arg1, ...):
<is arg1 a sparse matrix>
<is arg1 a tuple>
else:
# must be dense
try:
arg1 = np.asarray(arg1)
except:
raise ValueError("unrecognized %s_matrix constructor usage" % self.format)
My guess it that it tries:
np.asarray([[10 for i in range(70000)] for j in range(70000)])
and that results in some sort of error, most likely 'too large' or 'memory'. That error is caught, and reissued with this 'unrecognized ..' message.
Try
A = np.array(a)
M = sparse.csr_matrix(A)
I suspect it will give you a more informative error message.
