Call me crazy but I’m not a fan of Docker. Yes it allows you to easily create complex container environments with one command but I’d prefer to manage the underlying operating system myself. However in some situations the software is of such high quality and its dependency management is such a nightmare that I resort to running Docker inside LXC.
Frigate is an amazing open source network video recording (NVR) system. Recently they released support for using NVIDIA GPUs for hardware acceleration. The rest of this post outlines how to enable GPU passthrough from your Bare-metal Host > LXC > Docker > Frigate.
LXC NVIDIA Passthrough
Assuming you already have an LXC container created, enable NVIDIA capabilities for the container:
You can confirm NVIDIA configuration by running:
You should see at least these two configuration entries:
Docker NVIDIA Passthrough
Now inside your container, setup docker, as an example:
docker-compose.yml file you’ll need to setup GPU passthrough:
Now if you start your docker container you’ll most likely end up with this error:
Here Docker is expecting to read your GPU from
/proc/driver/nvidia/gpus/0000:01:00.0 however LXC Passthrough has already mounted it to
Fix for Double Passthrough
To resolve this issue a simple symlink should work, however we need to execute it every time Docker starts. This is where the magic of SystemD shines. Create a new unit file at
Enable the service file, and restart Docker:
Note: You may have to change your GPU number if required ie:
You should now be able to start your container and see the relevant symlink file. The magic here is the line
Before=docker.service this instructs SystemD that this service must be started before Docker.
Hope this helps you.