scraper
Projects with this topic
-
A bash script for scraping xvideos videos metadata in json
Updated -
A bash script for scraping redtube videos metadata in json
Updated -
A shell script for downloading sexstories in nicely formatted files
Updated -
A very simple shell script for scraping imdb in json
Updated -
A very simple shell script for downloading foxnews in json
Updated -
A bash script for scraping comments from disqus
Updated -
This tool was designed to extract member institution locations from the official North American Reciprocal Association (NARM) website and places them into KML format. There are a few Google maps versions of this data created by individuals out there (like this one) that are probably mostly accurate, but the reciprocal agreements evidently update at least annually, which means they have a higher potential for inaccuracy every year they are not updated. Hopefully that dynamism within the NARM locations makes this script a particularly useful one, as (in theory) until NARM makes a major update to their website source code, this scraper will always produce a kml file with the most updated map at any time of any year.
Updated -
A bash script for scraping xhamster metadata of pages in json
Updated -
Scrape a web page and downloads images (even if they are on other linked pages)
Updated -
Scraper de proyectos de ley del Congreso Peruano
Updated -
Downloads sites from Web Archive / Wayback Machine [beta]
Updated -
Findpapers is an application that helps researchers who are looking for references for their work
Updated -
Scrapes various websites for daily meal menus. https://slichta.vercel.app/
Updated -
Made to scrape known moons from Wikipedia for lastmiles streams (https://twitch.tv/lastmiles)
Updated -
Simple scraper of job websites with clustering visualisation options
Updated -
A web scraper which capture the Article Title, Article Abstract, Article Content, Date-time, and the tweet's description on the cointelegraph.com news.
Updated -
A web scraper which capture the Title, Authors, Membership Lv, Num of merited, Text, Date-time, and Original poster from the "Bitcoin Discussion" sub-category discussions.
Updated -
BASH script to find free tracks and albums from any discography page on bandcamp.
Updated -
Discover apps by different mehtods. Mass download app packages and metadata.
Updated -
System rekomendacji płytek (kafelków), przypominający popularną aplikację randkową. Oferta płytek jest scrape'owana ze stron internetowych Castorama i Cersanit. Rekomendacja odbywa się algorytmem collaborative filtering.
Updated