Explore projects
-
COSSAS / bigphish
Apache License 2.0BigPhish - An all-in-one solution to identify and monitor phishing kit deployment
Updated -
Solebull / dwse
GNU General Public License v3.0 onlyDark Web Search Engine : a dark net crawler and database viewer.
Updated -
Laurent Arnoud / validate-website
MIT LicenseWeb crawler for checking the validity of your documents.
Updated -
Jonatas Grosman / findpapers
MIT LicenseFindpapers is an application that helps researchers who are looking for references for their work
Updated -
Novel Feast is the website where you can read Chinese, Japanese, and Korean Web Novels, Web Comics Light Novels Online Free https://novelfeast.com/novels
Updated -
-
-
marzzzello / gplaycrawler
MIT LicenseDiscover apps by different mehtods. Mass download app packages and metadata.
Updated -
Bilingual TED-TALK, Crawler, Crawling
Updated -
Roger Fedor / DataHorde
MIT LicenseA data scraping and manipulation library with command line interface with multi-database support for MSSQL, MySQL, PSQL, MariaDB and SQLite. View jsdoc and coverage reports at, https://rdfedor.gitlab.io/datahorde
Updated -
A Python crawler to gather information about augmented reality applications. (For a research project.)
Updated -
Daniel Snider / crawler
GNU Affero General Public License v3.0A Python app for scanning large data sets of URLs for a given signature and storing the results to an ElasticSearch index. Useful applications for CERTs and security researchers, maybe others.
Updated -
Cristian Souza / python-hacking-tools
GNU General Public License v3.0 or laterPython tools for ethical hacking
Updated -
Ethereum Internal Transaction Crawler lets you extract internal transactions from etherscan.io and transform them into CSV format.
Updated -
-
Gui Don / claes-crawler
MIT LicenseA crawler that looks like a browser for distant servers.
Updated -
-
Oliver Galvin / ua_spoofer
Apache License 2.0A Python module for collecting and providing popular user agent strings, with a requests session which rotates user agents.
Updated -
A web-spider implemented with Scrapy, to crawl GoogleNews
Updated