How to resolve dependencies of Python Git Submodule

The problem I have now though is that if the code in the git submodule has external pip dependencies, how do the top-level projects resolve those dependencies in addition to their own?

In your sub-module repository, include your dependencies in requirements.txt as usual.

Then in your documentation, be sure to include instructions on installing the sub-module package before installing A, B, or C.

For an example, lets say that package A is foo, and the sub-module is bar.

tree
.
└── foo
    ├── bar
    │   ├── bar
    │   │   └── __init__.py
    │   ├── requirements.txt # external pip dependencies
    │   └── setup.py
    ├── foo
    │   └── __init__.py
    ├── requirements.txt
    └── setup.py # include 

4 directories, 6 files

Then in your documentation you can include something like this,

Installation for Foo

# Initialize submodule(s)
git submodule update --init --recursive

# First install bar
cd bar

# Resolve any dependencies for bar
pip install -r requirements.txt

# Install bar
python setup.py install

# Now install foo
cd ..

# Resolve any other dependencies for foo
pip install -r requirements.txt

# Install foo
python setup.py install

Note: This should be done for all three repositories, e.g., A, B, and C.

Resources:

• https://github.com/pypa/sampleproject

Using git submodule foreach makes this very easy:

git submodule --quiet foreach --recursive pip install -r requirements.txt

This also solves any issues you might've with installing local wheels for submodules since this runs from the submodule's directory (and not the main project's directory).