So, where were we?⌗
I was documenting the tale of setting up a rendering node using CUDA on a headless Docker host.
In the last episode we got our Docker/Kubernetes host working with the NVIDIA drivers and Container runtime so we can deploy GPU accelerated workloads.
Now, we need the workload - a Blender rendering node.
OK, easy, just deploy Blender…⌗
…and use the network rendering feature right?
Alas, wrong. Because Blender recently removed the simple network rendering it had built in, and the Network Render extension with it.
So now, you need to get a third-party service, CrowdRender, working.
Now, I don’t want to say anything bad about CrowdRender - when it works, it works very well. Indeed, I’m impressed enough I’ve donated to their crowdfunding appeal - but, getting it to work can be tricksy (it does warn you that it is Alpha software, after all.) So here are a few tips - they took longer to work out than to write, so hopefully they will help someone.
The Docker Image⌗
First, the good news - there is already a Docker image for running Blender on your compute note. You’ll find it on DockerHub as zocker160/blender-crowdrender.
Read the instructions on this carefully. Since in the last episode we got
CUDA working properly on our host, we can use the
:nvidia tag to get the
GPU accelerated version of the image. This is an alias for
but read the Version Table on that docker README carefully, because:
That means you must use Blender 2.82a as your desktop/client
It turns out that Blender and Crowd-Render are really really picky about which version will work with which.
You also need to be careful that the version of Crowd-Render you run on the server also matches the version of the plugin you install in your client. So, once you’ve accepted that you know you will be using the correct version of Blender, you also need to decide which version of the extension (or ‘Add On’ in Blender terminology) you are going to use, based on the support matrix shown in the Docker README and also in the Crowd Render download page. Use whichever appears to be more recent…
So, to illustrate how my finally working set of versions looks:
|Blender (on the client)||2.82a|
||This is Blender 2.82, with CUDA10 support. I prefer to specify this, not
|Crowd-Render Add-On (on the client)||0.2.9 for Blender 2.8x||This was the most current version for free download that supports Blender 2.8|
||This is the name of the install file for the CR plugin you downloaded|
That last CR_VERSION is important, because you are going to pass it to the
docker run command to ensure that the version of CrowdRender downloaded
by the Docker image matches the version you installed on your desktop Blender
If you get any of this wrong, do not expect friendly “oops, you are using the wrong version” errors. The failures are likely to be silent and mysterious - so choose wisely and type carefully.
OK, I think I’m ready…⌗
So, you have the versions straight in your head? Good, then what you need to do is quite simple:
- Download and install the correct version of Blender on your desktop. The Blender website will try really hard to make you download the latest version - don’t let it trick you! If the website drives you crazy, try this direct link.
- Download and install the correct version of the Add On for your desktop client from the Crowd-Render Website.
Now you should be ready to install the server component. The following Docker command will do what you need; note that you are specifying the correct version of CR to download, to avoid any surprises.
docker run -d --name my-crowdrender-host \ --net=host \ --restart=unless-stopped \ -e token=***THE TOKEN YOU WILL GET FROM THE CROWDRENDER SITE*** -e CR_VERSION=cr_029_bl280 \ --gpus all \ zocker160/blender-crowdrender:bl_2.82_cu_10
Now, in theory, you can follow the instructions on the CrowdRender website, to enable the CR plugin in your client and then connect to your new rendering node.
Note: Your Docker container will need to be able to connect to the Crowd-Render website, to download the plugin image. (That token you give to the Docker image is basically a login token that lets it download the plugin from the same place you downloaded it for the desktop.) This should only be necessary the first time the container is initialised though, when the plugin is downloaded and installed.
What if it doesn’t?⌗
What if it just silently fails giving you a black screen without any error?
First, make sure in your Blender client’s rendering settings that you chose a Render Engine that supports headless rendering, like Cycles.
If that doesn’t solve your problem, firstly, you should take the normal step
of checking the docker container logs using
docker logs --follow my-crowdrender-host2 -
hopefully, you will see an error or similar there that will point you in the
direction of a solution. If nothing obvious appears though, you may need to
dig deeper into Blender’s logs stored inside the container.
To do this, create a shell on
the container (
docker exec -it my-crowdrender-host sh), and hunt for logfiles -
you want to start your search in the
/root/cr/logging directory on the
Some tips from personal experience that might help:
Blender runs on the server with –noaudio. So why would you need audio drivers?
Search me, it’s a mystery. And yet… Blender will still fail with a
cannot open /dev/dsp error. If you find a message like this buried within
the logs, I solved it with:
apt-get install osspd-alsa
…on the Docker host machine. Then restart the Docker service with
sudo service docker restart (or equivalent.) You still won’t have a
device, but apparently there will be enough of a hint there for Blender to
decide it didn’t need one anyway.
No, I have no idea why. All I can say is - it worked for me. Apparently, this bug only seems to affect Ubuntu hosts (and, it should be noted - this is a bug in Blender rather than Crowd-Render.)
The Eevee rendering engine - which is unfortunately the default for a clean install of Blender - doesn’t support headless rendering (it depends on accessing the GPU through OpenGL, and needs an X Server to do it) - see the Eevee documentation for (not much) further detail.
Edited: 19th September 2020, with excellent feedback from the author of the CrowdRender Docker image, Zocker. Many thanks!
Two days after I wrote this, Zocker updated his images to support version 2.83 of Blender :-). Once I’ve had a chance to upgrade myself and check these instructions still work, I’ll update this article - but until then, note that you could go with that version, as long as you update all the relevant references (your own Blender version, and the CR_VERSION.) ↩︎
Or the name you gave the container, if you chose something different in the
docker runcommand. ↩︎