dockerbuild

Last week I was asked the question "how do I use Puppet manifests to build Docker images?"

It's a good question one and one I myself was struggling with since I'd like to have a go at doing exactly that. Turns out a few people have attempted this so far but they've all done so with private or highly customised solutions that involve installing puppet, running it and then removing it. No one was aware of an easy way of doing what the question asked... so I created one.

Introducing dockerbuild

dockerbuild is a system comprising a Docker image and a ruby script. Together, they allow you to build docker images from your Puppet manifests without having to hack around with Dockerfiles or (other) custom scripts.

The idea is that with only 2-3 commands you can generate a Docker image from your puppet code, so that your up and running in minutes not days.

Components

puppet-dockerbuild.rb script

This script is the core of the system, it starts a docker image and mounts /etc/puppetlabs and /opt/puppetlabs from the host it is run on. It then does puppet apply to include the requested class and commits the image.

dockerbuild docker image

Strictly speaking, you don't need this docker image at all to run the puppet-dockerbuild.rb script. It would work quite happily if you found a VM or server, installed Puppet Enterprise, Docker, all required gems and then ran the script. Of course this is a bit of a pain to setup so to save others the effort all of these prerequisites are installed and configured within a downloadable Docker image. There is a script which builds the image and pre-built images are available on my Docker Hub page.

Usage

Step 0: (Optional) Build your own dockerbuild image

The puppet_docker_images project contains a script you can use to build your own Puppet Master and optionally do things such as connect it to your corporate r10k repository:

build_image.rb
  --pe-version 2015.2.1 \
  --tag-version 0 \
  --hostname puppet.megacorp.com \
  --r10k-control https://git.megacorp.com/control_repo \
  --dockerbuild

Once a customised image has been built, you can tag it and push it to your private docker repository.
Note: There is not support for authenticating to git servers at the moment

Step 1: Download and start the dockerbuild image

You can download and start the image using the docker run command eg:

docker run --privileged -d geoffwilliams/pe2015.2.3_centos-7_aio-master_public_lowmem_dockerbuild

This will start the container running and detach it to the background. The container needs to be run in privileged mode for systemd to work correctly. You will probably also want to look at options for naming your container and using specific directories as volumes.

Step 2: Populate with puppet code

If you built your own image and used r10k, then you can skip this step as your code is already on the system, otherwise you need to figure out a way to get some puppet modules installed. To get your code into the container, you have a few options:

Its worth noting that the design intention is to keep dockerbuild containers around for as long as a release of Puppet Enterprise is current, you might need to update the code hosted inside the image so it could be worth setting up systems such as MCollective to refresh the code when needed.

Step 3: Create a docker image

With the dockerbuild container running, your now able to use the docker instance running inside of it to make new Docker images. For the moment, the easiest way to do this is probalby to use docker exec to gain shell access:

docker exec -ti CONTAINER_ID bash

You can then run the puppet-dockerbuild.rb script. Since your puppet code and hiera data are temporarily mounted into this container, you have full access to all the data you need, as if you were running your code on a regular puppet master.

The script arguments specify the base docker image to use (--base-image), the output image name (--output-image) and the name of a puppet class to include with puppet apply.

Note: your base image needs to be compatible (ie the same!) as the dockerbuild container (Centos 7 if downloading from the Docker Hub).

Example:

puppet_dockerbuild.rb --base-image centos \
                      --role-class apache \
                      --output-image DOCKER_IMAGE

Step 3: Done!

Once your image is built it will live inside the dockerbuild container. You can publish it to the docker hub or your own private Docker repository (these are manual steps at the moment). Once available, you can then use normal Docker commands to create containers from your image, or you could use garethr/docker and Puppet Enterprise to import and create containers from your new images. Pretty cool eh?

Caveats/todo