Add more config, resource, infra efficiency tips to Pipeline Efficiency docs
Problem to solve
The Pipeline Efficiency documentation provides great insights to become more efficient. Over the past 2 years, I have been adding more insights in talks and workshops, and also the tools like the GitLab CI Pipeline Exporter have evolved.
Further details
Additional learnings around Kubernetes deployments, config efficiency, observability, container builder images, matrix builds, auto-scaling, etc.
Dev Evangelism: Michael FY23 Thought leadership... (gitlab-com/marketing&2593 - closed) as ideas SSoT for Observability.
Proposal
Proposing to update the docs, with adding more details on different efficiency aspects helping with more sustainable pipelines.
- Follow the talk at Continuous Lifecycle https://docs.google.com/presentation/d/1nq7Q4WMv6rQc6WFJCRqjtgtgQfgtKTtwSFw4IXXuRsA/edit which is more focussed on GitLab
- Re-purpose the 10h workshop exercises for config/resource efficiency: https://about.gitlab.com/handbook/marketing/community-relations/developer-evangelism/projects/#efficient-devsecops-pipelines-in-a-cloud-native-world
- Pipeline Exporter v0.5.x breaking changes: https://github.com/mvisonneau/gitlab-ci-pipelines-exporter/releases/tag/v0.5.0
- Podman as executor - container image builds?
- Multi arch container builds
- Runner and agent debugging tips
- Infracost/kubecost
Who can address the issue
Other links/references
FYI @jheimbuck_gl @jreporter - I think it touches more groups, but I'll stick with grouppipeline execution for now.
Tasks
-
Configuration efficiency -
Best practices links -
CI/CD components
-
-
Add more observability possibilities from -
Cloudland 2023 talk #367062 (comment 1447420312) -
KubeCon NA 2023 lightning talk https://www.linkedin.com/posts/dnsmichi_observability-devsecops-kubeconna-activity-7127757023428980736-0kRz?utm_source=share&utm_medium=member_desktop
-
-
Document more caching strategies for more languages -
Add container images - distroless, small, etc. from Rejekts 2023 learnings -
Update the CI exporter screenshot from !128403 (closed)
Edited by Michael Friedrich