From a base URL, crawl a websites URLs (via href link traversal) and generate a Sitemap. Supports checking and cleaning up sitemap, and checking paths on a different base/host.

Name
Last commit
Last update
Project.toml Loading commit data...
check.jl Loading commit data...
crawl-sitemap.jl Loading commit data...
crawl.jl Loading commit data...
crawldata.jl Loading commit data...
filenames.jl Loading commit data...
test_sitemap.jl Loading commit data...