DEV Community

#webscraping

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
We benchmarked 4 web scraping APIs for AI agents against DataDome, Cloudflare, and Akamai

We benchmarked 4 web scraping APIs for AI agents against DataDome, Cloudflare, and Akamai

Comments 1
11 min read
Benchmark a product category on Alibaba before you source it (Python, real numbers)

Benchmark a product category on Alibaba before you source it (Python, real numbers)

Comments
3 min read
What a PSA 10 Charizard costs on Whatnot, from 73 live listings

What a PSA 10 Charizard costs on Whatnot, from 73 live listings

Comments
3 min read
pytrends is archived: fixing Google Trends 429 errors in 2026

pytrends is archived: fixing Google Trends 429 errors in 2026

Comments
3 min read
Google Maps results to emails: add contacts to a Maps Scraper dataset, one row per place

Google Maps results to emails: add contacts to a Maps Scraper dataset, one row per place

1
Comments
4 min read
How to Scrape Real Estate & Car Listings from OLX Brazil with OLX Brazil Scraper

How to Scrape Real Estate & Car Listings from OLX Brazil with OLX Brazil Scraper

Comments 1
6 min read
Residential Proxies Made My Lazada Scraper Worse: the Gate Reads the Handshake, Not the IP

Residential Proxies Made My Lazada Scraper Worse: the Gate Reads the Handshake, Not the IP

Comments
7 min read
Google Hotels API: hotel prices by date as JSON

Google Hotels API: hotel prices by date as JSON

5
Comments 1
3 min read
How to export Google Play reviews to CSV for any app and country

How to export Google Play reviews to CSV for any app and country

Comments
3 min read
How to bulk-audit local business websites

How to bulk-audit local business websites

Comments
6 min read
10,000 popular Shopify stores: e-mails, socials, shipping and discounts (October 2026)

10,000 popular Shopify stores: e-mails, socials, shipping and discounts (October 2026)

Comments
6 min read
Ask Threads for 50 Replies and Half of What Comes Back Is Other People's Posts

Ask Threads for 50 Replies and Half of What Comes Back Is Other People's Posts

Comments
6 min read
Google Ads Transparency Center API: export a competitor's Google ads

Google Ads Transparency Center API: export a competitor's Google ads

5
Comments 4
3 min read
7 tricks and 3 traps from scraping Twitch, YouTube, TikTok, Kick, Bluesky and Patreon with no login and no browser

7 tricks and 3 traps from scraping Twitch, YouTube, TikTok, Kick, Bluesky and Patreon with no login and no browser

Comments
3 min read
A Threads Search Result Is a Thread, Not a Post

A Threads Search Result Is a Thread, Not a Post

Comments
6 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.