W

webcrawler

A web scraper which capture the Title, Authors, Membership Lv, Num of merited, Text, Date-time, and Original poster from the "Bitcoin Discussion" sub-category discussions.

A web scraper which capture the Article Title, Article Abstract, Article Content, Date-time, and the tweet's description on the cointelegraph.com news.

InstantIndex is a privacy-first, locally hosted search engine that combines ultra-fast crawling, adaptive AI learning, and optimized archiving. Users can select their preferred language, and the system evolves its knowledge base based on search behavior while maintaining full data privacy. Optional modules include Paid Ad Video rewards, with verified viewing and secure digital wallet payouts. InstantIndex delivers personalized, accurate, and randomized results without compromising speed, space efficiency, or security.

A multi-threaded webcrawler written in C with libcURL and Lexbor.

A FFXIV Lodestone crawler for M'naago (Discord bot)

Para investidores cujo problema está na dificuldade em monitorar ofertas de propriedades com liquidez para vendas. O robô imobiliário é um Web crawler que irá comparar os valores a fim de ampliar os lucros e rentabilidade na compra de imóveis.

A web crawler to collect data from a public site using python with scrappy.

Scrapy learn project, web crawler

A little crawler to get the handle you want on twitter

This is a python web miner. This actually crawles or mine the hidden dir and files using async it is faster then the normal def sync.

Radial tree + graph visualization of Web page interlinking + simple Web crawler.