494 questions
0
votes
1
answer
77
views
How do I import mpi4py.MPI in a frozen executable?
I have a Python module that I would like to be able to run from the console, hence why I'm using pyinstaller. My module uses MPI and runs fine normally. Then I run the following:
pyinstaller my_script....
1
vote
0
answers
48
views
How to send/recv from a specific index in mpi4py
Here is a translation of an C+MPI example in Python+Numpy+mpi4py. The goal of this example was to show that the message received is put in memory and that memory is in one dimension
from mpi4py import ...
1
vote
2
answers
100
views
mpi4py deadlock with scipy.minimize
I am trying to do something similar as described in Parallelize a function call with mpi4py
But there are some things there that make me skeptical of the provided answer. Additionally, I have a class ...
0
votes
0
answers
162
views
Running pyscf parallelly using mpi4py
I am trying to use PySCF for electronic structure calculations and was curious about the parallelization schemes available to get the best performance.
I've installed PySCF via Spack, which included ...
0
votes
0
answers
57
views
mpi4py one-sided MPI test script
I am trying to install mpi-sppy and am stuck with running a basic test script to make sure that the one-sided MPI calls work. I am using MPICH on Ubuntu 22.04 on Windows 11 by WSL2. The versions are ...
0
votes
1
answer
161
views
Using MPI correctly with multithreaded NumPy functions
After reading the mpi4py documentation, I can't find any information about the use of MPI with multithreaded NumPy applications. That is, most of the mpi4py documentation related to NumPy involve data ...
0
votes
1
answer
95
views
Capture KeyboardInterrupt in context manager when OpenMPI run is manually terminated
I am running code in parallel using mpi4py. I've noticed that if I run the code and perform a keyboard interrupt, my context manager __exit__ will run if I run the code as python file.py but will not ...
0
votes
1
answer
115
views
MS-MPI and MPI4PY don't work on a real PC cluster
My LAN is composed of 1 PC Windows 10 Pro (manager) and 3 PCs Windows 11 Pro (workers). I installed on the PCs (manager and workers) MSMPI Microsoft MPI Startup Program Version 10.1.12498.52, MPI4PY v....
0
votes
0
answers
955
views
MPI misconfiguration, getting error: hwloc/linux: Ignoring PCI device wth non-16bit domain
I am trying to run a simple python program using mpi on Pop OS. I have installed MPICH
$ mpiexec --version
HYDRA build details:
Version: 4.2.1
Release Date: ...
0
votes
0
answers
898
views
Cannot Install mpi4py with pip - Building wheel failed
I have heard that there have been issues installing this package with Python 3.9 or higher (mine is 3.11.4), but I'm wondering if there is a workaround.
I ran:
python3 -m pip install mpi4py
and got:
...
0
votes
1
answer
134
views
MPI4py installation fails for python=3.8
I've been tryin to install mpi4py library within my Conda environment of python version 3.8.
I'm getting the following error message while installing through pip
Building wheel for mpi4py (pyproject....
0
votes
1
answer
43
views
why does this setup forming sub communicators deadlock in mpi4py
system: MacOSX 14.4.1
python: 3.11.8
mpi4py: 3.1.5
OpenMPI: 5.0.2 installed with homebrew
I have the following python script. The deadlock happens when I have 3 MPI ranks. I want to create a ...
0
votes
1
answer
186
views
Mpiexec taking forever to start (possible issue with MPIPoolExecutor)?
I am trying to run the following command:
mpiexec -n 1 python scratch.py
where scratch.py is a simple example provided here
from mpi4py.futures import MPIPoolExecutor
def square(i):
global initialized
...
1
vote
0
answers
177
views
MPI4PY doesn't spawn on multiple nodes
I wrote a Python code that spawns N sub-processes to run an executable, child, written in Fortran. I use an MPI Broadcast from the python main to communicate a message (a string that reads CNTRL) to ...
0
votes
0
answers
117
views
Scientific Linux 7.4: undefined symbol: ompi_mpi_logical8 error
I am trying to run a Python Package that uses MPI for running tasks in parallel.
as per the package's guidelines; I installed MPICH 4.2.0, followed my mpi4py.
However, after running their example ...
0
votes
0
answers
138
views
mpi4py how to scatter large pandas dataframe
I am trying to scatter a pandas dataframe to spawned children processes.
Here is what I have tried.
master.py
from mpi4py import MPI
import numpy as np
import sys
import pandas as pd
comm = MPI....
0
votes
0
answers
71
views
Code freezes when trying to append data received from MPI_recv with mpi4py
I have some code where I am trying to communicate data across processors. I have a nested list of neighbors, in which each element reperesents a subsection of the data, and the elements of that list ...
0
votes
0
answers
126
views
How to parallelize a for loop in python with mpi4py which needs to output an array of numbers?
I have a for loop which calculates a number in each iteration and sets it as a new element in a zeros array. How to parallelize this loop with mpi4py? Help is much appreciated! Code is given below.
...
2
votes
1
answer
102
views
Create a lot of simple classes with one member
Dealing with mypy @overload I wanted to have something like enum but for types.
You see, I deal with mpi4py and there is an argument tag that does nothing very useful, just separates messages (so that ...
0
votes
0
answers
1k
views
ERROR: Failed building wheel for mpi4py, Could not build wheels for mpi4py which use PEP 517 and cannot be installed directly
I am trying to install packages for a project in conda environment. I have issues in building wheel for mdp4py package. The package is installed but couldnt build a wheel for it.
The error code is too ...
0
votes
1
answer
2k
views
Failed to build mpi4py in Ubuntu 20.04 [duplicate]
Dear Community,
i am struggling with installing "mpi4py" on my Ubuntu 20.04 WSL. The error i am getting is the following:
pip install mpi4py
Defaulting to user installation because normal ...
0
votes
1
answer
1k
views
Installation of `mpi4py` failed because MPI compilers are not found
I am trying to install mpi4py through anaconda, and got this error.
/opt/spack/opt/spack/linux-rhel8-icelake/gcc-8.4.1/anaconda3-2021.05-fmo625scqdt32etnaksoexe3rd6sea7j/bin/mpicc -Wsign-compare -...
0
votes
1
answer
289
views
mpi4py memory leak when creating shared arrays
I have an application where I need to perform many loops, each of which will create a shared array that I want to overwrite the previously shared array.
When I try this, however, I run into what seems ...
0
votes
0
answers
18
views
mpi4py Installation failure on Ubuntu [duplicate]
I have openmpi-4.1.4 installed and python 3.9 on Ubuntu 18.04. When I go to build mpi4py from source, I get this error:
(DL) root@autodl-container-7e5411a952-3306111c:/usr/local/mpi4py/mpi4py-3.1.1# ...
0
votes
0
answers
266
views
How to properly finish a python MPI script?
I'm writing python code using mpi4py and its not finishing unless I manually cancel the job. My code is something like this:
from mpi4py import MPI
if __name__ == "__main__":
comm = MPI....