How to compile and execute C program with both MPI and OpenMP on Windows

Question

I have a program on C that uses both MPI and OpenMP. In order to compile such program on Windows system I have downloaded and installed a gcc compiler provided by MinGW. Using this compiler I can compile and execute C programs with OpenMP using the key -fopenmp for gcc. Such programs run without problems. In order to compile and execute C programs with MPI I have downloaded and installed MPICH2. Now I can compile and run such programs without problems, specifying additional parameters for gcc, provided by MinGW. But when I want to compile and run a program that uses both OpenMP and MPI I have a problem. I specified both keys -fopenmp and keys for MPI program for gcc compiler. Compilator didn't give me any error. I tried to launch my program by mpiexec, provided by MPICH2. My program didn't want to work (It was a HelloWorld program and it didn't print anything to output). Please help me to compile and launch such programs correctly.

Here is my HelloWorld program, that doesn't produce any output.

#include <stdio.h>
#include <mpi.h>

int main(int argc, char ** argv)
{
    int thnum, thtotal;
    int pid, np;

    MPI_Init(&argc,&argv);
    MPI_Comm_rank(MPI_COMM_WORLD,&pid);
    MPI_Comm_size(MPI_COMM_WORLD,&np);

    printf("Sequental %d out of %d!\n",pid,np);
    MPI_Barrier(MPI_COMM_WORLD);

    #pragma omp parallel private(thnum,thtotal)
    {
        thnum = omp_get_thread_num();
        thtotal = omp_get_num_threads();
        printf("parallel: %d out of %d from proc %d out of %d\n",thnum,thtotal,pid,np);

    }
    MPI_Barrier(MPI_COMM_WORLD);
    MPI_Finalize();
    return 0;
}

Can you get an MPI-only program to work (without OpenMP)? What are the exact steps you take to build and run the program? — Greg Inozemtsev
– Greg Inozemtsev, Commented Oct 10, 2012 at 4:21
@GregInozemtsev MPI-only program works good. To build and run MPI-only program I use: gcc -c -o main.o main.c -I"C:\...\MPHICH2\include"; gcc -o main.exe main.o -L"C:\...\MPICH2\lib" -lmpi; mpiexec -n 4 main.exe — Appliqué
– Appliqué, Commented Oct 10, 2012 at 9:07

Dimitri · Accepted Answer · 2012-10-09 08:42:31Z

3

You can use the mpicc compiler with the -openmp option. For example,

mpicc -openmp hello.c -o hello

answered Oct 9, 2012 at 8:42

Dimitri

8,31819 gold badges75 silver badges133 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

Appliqué Over a year ago

Thank you for answer! Unfortunately, MPICH2 for Windows doesn't contain such compilator (At least I can't find it in "bin" directory, but I have it on my Unix(AIX) server thanks to MPICH).

Dimitri Over a year ago

Can you add more details about your errors. What is the output of your errors?

Hristo Iliev · Accepted Answer · 2012-10-10 09:50:54Z

0

This might not be the root cause of your problem, but the MPI standard mandates that threaded programs use MPI_Init_thread() instead of MPI_Init(). In your case there are no MPI calls from within the parallel region so threading level of MPI_THREAD_FUNNELED should suffice. You should replace the call to MPI_Init() with:

int provided;

MPI_Init_thread(&argc, &argv, MPI_THREAD_FUNNELED, &provided);
if (provided < MPI_THREAD_FUNNELED)
{
    MPI_Abort(MPI_COMM_WORLD, 1);
    return 1; // Usually not reached
}

Although some MPI libraries might not advertise threading support (provided as returned is MPI_THREAD_SINGLE) they still work fine with hybrid OpenMP/MPI codes if one does not make MPI calls from within parallel regions.

answered Oct 10, 2012 at 9:50

Hristo Iliev

74.8k12 gold badges147 silver badges197 bronze badges

1 Comment

Appliqué Over a year ago

Thank you for answer! I replaced in my program the call to MPI_Init by your code. The inside section of if is not reached when I compile without -fopenmp key. But when I compile my program identically to the case of the MPI-only program but with -fopenmp key I receive a program that doesn't produce any output again.

David L. · Accepted Answer · 2012-10-11 04:03:02Z

0

The OpenMP portion of your program might require #include <omp.h> :

parallel: 0 out of 2 from proc 0 out of 0
parallel: 1 out of 2 from proc 0 out of 0

edited Oct 11, 2012 at 4:03

answered Oct 11, 2012 at 3:51

David L.

2,10323 silver badges23 bronze badges

1 Comment

Appliqué Over a year ago

I included this header file but there are no output again.

Collectives™ on Stack Overflow

How to compile and execute C program with both MPI and OpenMP on Windows

3 Answers 3

2 Comments

1 Comment

1 Comment

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

3 Answers 3

2 Comments

1 Comment

1 Comment

Your Answer

Sign up or log in

Post as a guest

Related