DEV Community

# webscraping

Posts

👋 Sign in for the ability to sort posts by relevant, latest, or top.
Give Your AI Agent Live Flight Data: Building a Google Flights API Tool in Python
sam_gale_376efd5d2fd14112 profile

Give Your AI Agent Live Flight Data: Building a Google Flights API Tool in Python

#agents #googleflightsapi #webscraping #python
Comments
14 min read
6 Firecrawl Alternatives for Developers in 2026
tinyfishie profile

6 Firecrawl Alternatives for Developers in 2026

#webscraping #firecrawl #developertools #webagents
Comments
9 min read
Best Puppeteer Alternatives for Browser Automation in 2026
tinyfishie profile

Best Puppeteer Alternatives for Browser Automation in 2026

#automation #javascript #node #webscraping
Comments
8 min read
Why Web Agents Fail on Protected Sites — And How to Fix It at the Infrastructure Level
tinyfishie profile

Why Web Agents Fail on Protected Sites — And How to Fix It at the Infrastructure Level

#agents #infrastructure #security #webscraping
Comments
7 min read
FULL SSRF + EXFILTRACION EN CRAWLEE
arturo0x90 profile

FULL SSRF + EXFILTRACION EN CRAWLEE

#cybersecurity #security #spanish #webscraping
Comments
12 min read
What I learned scraping Bulk URL Status Checker: schema, gotchas and the tooling that worked
can_ylmaz_da7b70586976b3 profile

What I learned scraping Bulk URL Status Checker: schema, gotchas and the tooling that worked

#webscraping #apify #data #tutorial
Comments
3 min read
Sample dataset analysis: a 100-row snapshot of Bazaraki
can_ylmaz_da7b70586976b3 profile

Sample dataset analysis: a 100-row snapshot of Bazaraki

#webscraping #apify #realestate #dataengineering
Comments
3 min read
Comparing approaches to extracting Hacker News Who Is Hiring data
can_ylmaz_da7b70586976b3 profile

Comparing approaches to extracting Hacker News Who Is Hiring data

#webscraping #apify #jobs #dataengineering
Comments
3 min read
Building a Letterboxd Film & Review data pipeline: from raw scrape to first insight
can_ylmaz_da7b70586976b3 profile

Building a Letterboxd Film & Review data pipeline: from raw scrape to first insight

#webscraping #apify #socialmedia #dataengineering
Comments
3 min read
What I learned scraping ClinicalTrials.gov: schema, gotchas and the tooling that worked
can_ylmaz_da7b70586976b3 profile

What I learned scraping ClinicalTrials.gov: schema, gotchas and the tooling that worked

#webscraping #apify #opendata #tutorial
Comments
3 min read
How I Built a Real Chinese Product Review Aggregator (and Why English Reviews Are Broken)
wuledan profile

How I Built a Real Chinese Product Review Aggregator (and Why English Reviews Are Broken)

#showdev #sideprojects #webdev #webscraping
Comments
1 min read
I stopped treating headless Chrome like a scraping strategy
0xmassi profile

I stopped treating headless Chrome like a scraping strategy

#ai #webdev #llm #webscraping
2
Comments
5 min read
Build a RAG Pipeline That Actually Reads the Web
gradill22 profile

Build a RAG Pipeline That Actually Reads the Web

#ragpipeline #generativeaitools #python #webscraping
Comments
9 min read
How I scraped Welcome to the Jungle Jobs and what the dataset actually looks like
can_ylmaz_da7b70586976b3 profile

How I scraped Welcome to the Jungle Jobs and what the dataset actually looks like

#webscraping #apify #jobs #tutorial
Comments
4 min read
What I learned scraping Website Contact: schema, gotchas and the tooling that worked
can_ylmaz_da7b70586976b3 profile

What I learned scraping Website Contact: schema, gotchas and the tooling that worked

#webscraping #apify #leadgen #tutorial
Comments
3 min read
👋 Sign in for the ability to sort posts by relevant, latest, or top.