Sitemap Crawler

From a base URL, crawl a websites URLs (via href link traversal) and generate a Sitemap. Supports checking and cleaning up sitemap, and checking paths on a different base/host.