Compile and run OpenMPI program

Question

The cluster I am using has several host types - different distributions/versions of Linux, some 32 bit, some 64 bit, different versions of GCC. I know that I should compile my program with platform specific MPI wrapper for GCC. This step is more or less clear to me.

My program uses fixed number of hosts and each host runs exactly 1 process. Shared memory threads are handled by TBB, so basically I need MPI only for work distribution between hosts.

The last step would be to run the program on all hosts. It turns out that it is the part I am not sure how to do and my IT folks couldn't help me.

What I have is a list of host IP addresses (local addresses to be precise, something like 192.168.1.xxx) and user name and password for each host. What are the step to run my program on all hosts, provided it was compiler with platform specific compiler and copied into each host? Any help appreciated.

René Richter · Accepted Answer · 2011-08-21 17:09:40Z

3

You need passwordless SSH access to all machines, a hostfile, the executable on all machines. Make sure the executable has the same (relative) path on all machines.

Hostfile (on the master machine):

# my_hostfile 
192.168.0.205
192.168.0.208

Command for Open MPI:

mpirun --hostfile my_hostfile programname

For passwordless SSH access create a masterkey under ~/.ssh

ssh-keygen -t rsa

Add the (one line) content of ~/.ssh/rsa.pub from your master machine to a new line in ~/.ssh/authorized_keys2 on your target machines. (Instead of RSA you can use another SSH cryptosystem.)

edited Aug 21, 2011 at 17:09

answered Aug 21, 2011 at 16:53

René Richter

3,9373 gold badges36 silver badges43 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

Martin Kristiansen Over a year ago

I've never used mpi but don't you need to startup something on the hosts?

Martin Kristiansen Over a year ago

I'm gonna try that out on the local cluster tomorrow morning. ;-)

Collectives™ on Stack Overflow

Compile and run OpenMPI program

1 Answer 1

2 Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

2 Comments

Your Answer

Sign up or log in

Post as a guest

Related