Skip to content

Notice about missing support for Auto Test when using .buildpacks file

Sven Gerlach requested to merge svengerlach/gitlab-ee:master into master

I had a hard time while testing out the Auto Dev Ops feature. We're a PHP shop and we're testing our stuff with phpunit. The official php buildpack doesn't support the testing feature (bin/test + bin/test-compile are missing) as of now (but as we'd like to move things forward, we provided a merge request for it).

I also learned from the documentation, that there are two ways to make the build pipeline use a custom buildpack (because, yes, we forked Heroku's official php buildpack as we really wanted to use the Auto Test feature):

  • Using the project variable BUILDPACK_URL (that worked flawlessly) and
  • by providing a .buildpacks file.

I took the .buildpacks road, because I like the idea of having everything CI-relevant within the repository without the necessity to setup project variables and stuff using a web UI.

It was quite hard to figure out the origin behind the idea of the .buildpacks file, but I finally came to the conclusion, that this feature is provided by Heroku's multi buildpack. And again, that buildpack doesn't support tests because of the missing files bin/test and bin/test-compile. So that brought me nowhere, back to step one, using project variables.

It could have saved me quite a lot of time doing research, when Gitlab's Auto Dev Ops documentation would have warned me, that the Auto Test feature isn't available, when I use the .buildpacks file to provide a custom buildpack.

I think other developers will run into this too, so I propose a documentation update.

Edited by 🤖 GitLab Bot 🤖

Merge request reports