WIP - Composable Sitemap
What does this MR do?
Supports #8302 (closed)
Rewrite sitemap to be composed of index of different sitemaps, to prepare for independent deploys: https://www.sitemaps.org/protocol.html#index
- Each builds job builds its own sitemap based on the files it builds, and main sitemap includes them all.
- Allows deletion of
bin/combine-sitemapscomplexity and coupling from deploy process. - Remember to remove hardcoded handling of
sitemap.xmlfromextensions/monorepo.rb.
Tasks
-
Verify before and after with https://datayze.com/sitemap-index-analyzer -
Verify counts of URLs before and after with commands like: - BEFORE (handbook paths in single-file sitemap):
cat /tmp/sitemap.xml | grep 'about.gitlab.com/handbook' | wc -l(1653) - AFTER (loc elements in handbook partial build sitemap):
cat public/handbook/sitemap_handbook.xml | grep loc | wc -l(1653)
- BEFORE (handbook paths in single-file sitemap):
-
Also use grep commands like above to ensure total number of links are generated before and after (4703/4703)
Existing "BEFORE" sitemap for future reference: sitemap.xml
BEFORE
AFTER
Related issues
Relates #8302 (closed)
Edited by Chad Woolley