Commits · 7202c1561d43670e896a724b491fe36589d02082 · Jan Klass / Sitemap Crawler

12 Nov, 2018 2 commits
- ff · 7202c156
  Jan Klass authored Nov 13, 2018
  
  7202c156
- Split code into files. Implement crawl forcehttps parameter. · 94408e42
  Jan Klass authored Nov 13, 2018
```
Argument help
Argument checks
CrawlData struct type
Pass data as parameters to crawl functions
```
  94408e42
11 Nov, 2018 3 commits
- Implement arguments, implement checking sitemap URLs for validity · abfafa05
  Jan Klass authored Nov 11, 2018
  
  abfafa05
- Handle failures, handle redirects, improve logging · 8cc4722c
  Jan Klass authored Nov 11, 2018
  
  8cc4722c
- Initial crawler and sitemap generator · ef5ee13e
  Jan Klass authored Nov 11, 2018
  
  ef5ee13e