Consider changing the base image of our Docker image

We are using Ubuntu 16.04 for simplicity of setting up the Docker image.

We should look into what would using leaner base image mean, alpine or something similarly lean.

We don't have to switch but it would be nice to investigate the effort and add notes in the docker docs.

cc @gitlab-build-team