Explore projects
-
Jonatas Grosman / findpapers
MIT LicenseFindpapers is an application that helps researchers who are looking for references for their work
Updated -
-
Cristian Souza / python-hacking-tools
GNU General Public License v3.0 or laterPython tools for ethical hacking
Updated -
Solebull / dwse
GNU General Public License v3.0 onlyDark Web Search Engine : a dark net crawler and database viewer.
Updated -
-
marzzzello / gplaycrawler
MIT LicenseDiscover apps by different mehtods. Mass download app packages and metadata.
Updated -
Oliver Galvin / ua_spoofer
Apache License 2.0A Python module for collecting and providing popular user agent strings, with a requests session which rotates user agents.
Updated -
Daniel Snider / crawler
GNU Affero General Public License v3.0A Python app for scanning large data sets of URLs for a given signature and storing the results to an ElasticSearch index. Useful applications for CERTs and security researchers, maybe others.
Updated -
Crawler which can crawl and download videos from YouTube and Vimeo
Updated -
Adrian B.G. / warmcache
GNU General Public License v3.0 or laterA simple tool to scan your website to keep your cache hot & ready. Helper tool for Prerender, Squid, CDN etc..
Updated -
-
From a base URL, crawl a websites URLs (via href link traversal) and generate a Sitemap. Supports checking and cleaning up sitemap, and checking paths on a different base/host.
Updated -
Alex / srogue11
BSD 3-Clause "New" or "Revised" Licenserefactor of RogueLikeRestorationProject/srogue to make it meet C11 standard
Updated -
A web-spider implemented with Scrapy, to crawl GoogleNews
Updated -
explore and download movies much EASIER
Updated -
This script is created for scraping Data from MCGM web-site
Updated -
-
Novel Feast is the website where you can read Chinese, Japanese, and Korean Web Novels, Web Comics Light Novels Online Free https://novelfeast.com/novels
Updated -
Roger Fedor / DataHorde
MIT LicenseA data scraping and manipulation library with command line interface with multi-database support for MSSQL, MySQL, PSQL, MariaDB and SQLite. View jsdoc and coverage reports at, https://rdfedor.gitlab.io/datahorde
Updated