Docker compose with GPU access

Question

my docker compose file is as follows:

version: "3"

services:
  app:
    build:
      context: .
      dockerfile: Dockerfile
    ports:
      - "5000:5000"
    deploy:
      resources:
        reservations:
          devices:
            - driver: nvidia
              count: 1
              capabilities: [gpu]

I am trying to allow my container to have GPU access. The same thing can happen with docker run --gpus all but I want it with docker compose. The yml above produces this error:

ERROR: The Compose file './docker-compose.yml' is invalid because:
services.app.deploy.resources.reservations value Additional properties are not allowed ('devices' was unexpected)

I don't understand how can this be a problem since what I used is what the official docs have (link).

Any ideas?

Zafer Cavdar · Accepted Answer · 2023-08-02 10:02:28Z

2

The deploy section is intended for Swarm deployments, and the resources key under deploy is used to configure resource reservations like CPU and memory. For GPU access, you should use a different method.

To enable GPU access in your Docker Compose file, you can use the runtime key under the service, like this:

version: "3"

services:
  app:
    build:
      context: .
      dockerfile: Dockerfile
    ports:
      - "5000:5000"
    runtime: nvidia  # This enables GPU access for the service

answered Aug 2, 2023 at 10:02

Zafer Cavdar

1039 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Docker compose with GPU access

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related