A Chrome DevTools Protocol driver for web automation and scraping.
scrape data data from Google Maps. Extracts data such as the name, address, phone number, website URL, rating, reviews number, latitude and longitude, reviews,email and more for each place
DataHen Till is a companion tool to your existing web scraper that instantly makes it scalable, maintainable, and more unblockable, with minimal code changes on your scraper. Integrates with any scraper in 5 minutes.
The unix-way web crawler
🕷️ An easy-to-use spider written in Golang. (previous named GOPA.)
Golang Crawling and scraping framework
Go cascadia package command line CSS selector
Download/access photos, videos, stories, story highlights, postlives, following and followers of Instagram
fast cmd-line app that quickly requests millions of urls and can save/echo the results
🥷 A simple puppeteer evasions shim for playwright-go projects.
Yet Another Streaming Tool
Spider - web crawler and local wordlist processor to generate frequency sorted wordlist / ngrams
simple Go CLI app that scrapes live prices
Get Links (URL) of Instagram Stories in Go
Learn how to scrape web content from HTML and see how web scraping differs to web crawling
DataHen useragent tool is a Golang package and standalone tool that generates a random combination of millions of user-agents strings. Currently used in production at DataHen to crawl/scrape through billions of pages.
Web and MacOS App to scrape data from Google Maps. Extracts data such as the name, address, phone number, website URL, rating, reviews number, latitude and longitude, reviews, email and more for each place.
Add a description, image, and links to the web-scraping topic page so that developers can more easily learn about it.
To associate your repository with the web-scraping topic, visit your repo's landing page and select "manage topics."