Check maximum memory usage of Python program under Windows

Question

I would like to obtain, from within the Python program, the maximum physical memory used by a Python program (ActiveState Python 3.2, under Windows 7).

Ideally, every 0.1 sec or so, I'd like to have memory usage polled, and if it exceeds the maximum seen so far, the maximum value (a global variable stored somewhere), updated.

UPDATE:

I realize my question is a close duplicate of Which Python memory profiler is recommended?.

Sorry for being unclear. I have two specific problems that are not, to my knowledge, addressed by a regular memory profiler:

I need to see not only the memory allocated by Python, but the total memory used by the Python program (under Windows, this would include DLLs, etc.). In other words, under Windows, this is exactly what you'd see in the Task Manager.
I need to see the maximum memory rather than the memory at any given instant. I can't think of a way to do that other than to place numerous memory checks all around the code whenever I think I'm allocating something large.

possible duplicate of Python memory profiler

Lennart Regebro
– Lennart Regebro

2012-02-03 19:14:09 +00:00
Commented Feb 3, 2012 at 19:14 — Lennart Regebro
– Lennart Regebro, Commented Feb 3, 2012 at 19:14
thx.. question updated to address this

max
– max

2012-06-22 23:45:42 +00:00
Commented Jun 22, 2012 at 23:45 — max
– max, Commented Jun 22, 2012 at 23:45

Youcha · Accepted Answer · 2012-06-23 00:12:39Z

2

I think you could go under Control Panel, Admin Tools, Performances, click on the '+', select 'Processor' under 'Performance Object', Pool Paged Bytes or Pool Unpaged Bytes under the left column and you select your process under the right column. You can generate a log file with the Performance monitor.

answered Jun 23, 2012 at 0:12

Youcha

1,5642 gold badges17 silver badges30 bronze badges

Sign up to request clarification or add additional context in comments.

3 Comments

max Over a year ago

Wow this far better than I expected. By any chance, do you know if this or a similar tool can monitor the clock speed of a discrete graphics card in my laptop? I am trying to diagnose some lag...

Youcha Over a year ago

I think there are several tools like RivaTuner for nVidia cards but they are specific to the card you're using. What card do you have?

max Over a year ago

nVidia, so I'm going to try it. Thanks.

max · Accepted Answer · 2012-06-22 23:48:00Z

1

I did not find any way to do precisely what I want with Python.

However, in playing with Windows 7 Task Manager, I found I can add a column "Peak Working Set (Memory)". So if I simply pause the python program before it can exit (and catch exceptions from main() to pause for the same reason), I can see the peak memory in the task manager.

I know it's stupid (e.g., it doesn't allow me to print it to a log file, do something based on how memory I'm using, etc.), but it's better than nothing.

answered Jun 22, 2012 at 23:48

max

52.7k60 gold badges224 silver badges379 bronze badges

Comments

Community · Accepted Answer · 2017-05-23 12:34:53Z

0

Here's a link to a similar question:

Which Python memory profiler is recommended?

I've used Guppy/Heapy and Meliae. They're a little different, but I've found both are quite useful.

edited May 23, 2017 at 12:34

CommunityBot

11 silver badge

answered Feb 3, 2012 at 17:27

Di Zou

4,63913 gold badges61 silver badges91 bronze badges

Collectives™ on Stack Overflow

Check maximum memory usage of Python program under Windows

3 Answers 3

3 Comments

Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

3 Comments

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related