Numpy gives memory error while running a Python file

Question

I'm trying to run a Python file, but every time it gives me this error. What could be the cause of this error and a possible solution? I'm using the latest version of numpy-1.17.0

numpy.core._exceptions.MemoryError: Unable to allocate array with shape 
(129941, 400, 16) and data type int32

Kindly provide the traceback and the code snippet that errors out. — WGS
– WGS, Commented Aug 11, 2019 at 9:26

ErgiS · Accepted Answer · 2019-08-11 09:28:40Z

1

I think your array is too big. int32 is 32 bits so 4 bytes and 4*129941*400*16 = 3326489600 bytes = 3.3264896 Gigabytes.

answered Aug 11, 2019 at 9:28

ErgiS

2232 silver badges12 bronze badges

Sign up to request clarification or add additional context in comments.

3 Comments

stats_residue Over a year ago

what can be the possible solution?

ErgiS Over a year ago

use a smaller array @JaydeepBorkar

stats_residue Over a year ago

I freed up some space by killing unnecessary processes and it worked. Thanks for the help :)

Prajot Kuvalekar · Accepted Answer · 2021-06-09 11:06:28Z

0

This is likely due to your system's overcommit handling mode.
In the default mode, 0,
You can check it using

$ cat /proc/sys/vm/overcommit_memory

You have to set it 1,using

$ echo 1 | sudo tee /proc/sys/vm/overcommit_memory

answered Jun 9, 2021 at 11:06

Prajot Kuvalekar

6,7943 gold badges28 silver badges34 bronze badges

Collectives™ on Stack Overflow

Numpy gives memory error while running a Python file

2 Answers 2

3 Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

3 Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related