W

webcrawler

InstantIndex is a privacy-first, locally hosted search engine that combines ultra-fast crawling, adaptive AI learning, and optimized archiving. Users can select their preferred language, and the system evolves its knowledge base based on search behavior while maintaining full data privacy. Optional modules include Paid Ad Video rewards, with verified viewing and secure digital wallet payouts. InstantIndex delivers personalized, accurate, and randomized results without compromising speed, space efficiency, or security.

A FFXIV Lodestone crawler for M'naago (Discord bot)

This is a python web miner. This actually crawles or mine the hidden dir and files using async it is faster then the normal def sync.

Radial tree + graph visualization of Web page interlinking + simple Web crawler.

A multi-threaded webcrawler written in C with libcURL and Lexbor.

A web scraper which capture the Article Title, Article Abstract, Article Content, Date-time, and the tweet's description on the cointelegraph.com news.

A web scraper which capture the Title, Authors, Membership Lv, Num of merited, Text, Date-time, and Original poster from the "Bitcoin Discussion" sub-category discussions.

A web crawler to collect data from a public site using python with scrappy.

Para investidores cujo problema está na dificuldade em monitorar ofertas de propriedades com liquidez para vendas. O robô imobiliário é um Web crawler que irá comparar os valores a fim de ampliar os lucros e rentabilidade na compra de imóveis.

Scrapy learn project, web crawler

A little crawler to get the handle you want on twitter