Python command line loop

Question

I'm running a mrjob python script, and in the command line I can pass the number of cores for the system to use.

python example_script.py --num-cores 5

I'm looking to run the script for n number of cores for beach marking performance test. IE: I want to run it for 1 core, 2 core etc.

Is there anyway I can write a loop directly into the command line rather then having to write out the whole command n number of times?

I want to test the performance of the script across n number of cores — F.D
– F.D, Commented Apr 27, 2018 at 14:26
But why do you want to pass the number of cores that way? Why not a simple integer? That's what a number of cores is, not a range. — mafrasi2
– mafrasi2, Commented Apr 27, 2018 at 14:29
@mafrasi2 ok, perhaps I wasn't clear. I updated the question there and hope it's clearer now? — F.D
– F.D, Commented Apr 27, 2018 at 14:32

SgtMajorJay · Accepted Answer · 2018-04-27 14:39:33Z

1

As in you want to lunch 4 isntances of mrjob each with increasing number of cores?

i.e.

python mrjob.py --num-core-instances=1
python mrjob.py --num-core-instances=2
python mrjob.py --num-core-instances=3
python mrjob.py --num-core-instances=4

In that case I don't think you can. You can make a script that lunches those for you though.

import subprocess
for i in range(1,5):
    subprocess.Popen(["start","cmd","/k","python","mrjob.py","--num-core-instance="+i],shell=True)

answered Apr 27, 2018 at 14:39

SgtMajorJay

1294 bronze badges

Sign up to request clarification or add additional context in comments.

Comments

cdrom · Accepted Answer · 2018-04-27 14:42:37Z

1

Is this what you want to do ?

for i in {1..10} ; do python example_script.py --num-cores $i ; done ;

It is a bash for loop.

answered Apr 27, 2018 at 14:42

cdrom

5913 silver badges16 bronze badges

Collectives™ on Stack Overflow

Python command line loop

2 Answers 2

Comments

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related