Remove benchmark suite
The benchmark suite was added before we had both Sherlock and the InfluxDB/Grafana based monitoring setup. The idea was to add a set of benchmarks to catch performance regressions before they would be deployed. Sadly there are numerous problems with this setup such as:
- Benchmarks have to be written manually and many developers (including me) just don't want to write them.
- Benchmarks are difficult to write as often performance is influenced by the environment's configuration, amount of data in a database, etc
- Benchmark timings are unreliable in the CI environment as performance can be influenced by the load put on a server
- Benchmarks don't give any insight in production performance, in particular benchmark and production performance can be radically different
As such I'll be removing the benchmark suite from the source code at some point. Instead I'll be working towards setting up some sort of "Performance For Mortals" guide as well as just setting up more Grafana dashboards whenever needed.