DEV Community

Andrii Votiakov profile picture

Andrii Votiakov

Software engineer & fCTO, 15+ yrs. I scrape the web at scale, build software products end to end, and cut cloud bills up to 90%. Founder of reducecost.cloud and Cartpie.com. Took two startups 0→£m

Location Łódź, Poland Joined Joined on  Personal website https://reducecost.cloud github website

Education

B.A.Sc. Computer Science, Lodz University of Technology

Work

Software engineer & fractional CTO · Founder of reducecost.cloud and Cartpie · Co-founder of Fabla

My pipeline parsed every page twice, and I blamed the parser

Summer Bug Smash: Smash Stories 🐛🛹
votiakov profile

My pipeline parsed every page twice, and I blamed the parser

#devchallenge #bugsmash #webscraping #performance
Comments
5 min read

Want to connect with Andrii Votiakov?

Create an account to connect with Andrii Votiakov. You can also sign in below to proceed if you already have an account.

Create Account
Already have an account? Sign in
Scraping millions of pages a day: what actually breaks
votiakov profile

Scraping millions of pages a day: what actually breaks

#webscraping #distributedsystems #devops #python
3
Comments 6
4 min read
Anti-bot without melting your budget: the proxy waterfall.
votiakov profile

Anti-bot without melting your budget: the proxy waterfall.

#webscraping #devops #python
1
Comments
4 min read
Your scraper probably doesn't need a browser. It needs the right request.
votiakov profile

Your scraper probably doesn't need a browser. It needs the right request.

#webscraping #javascript #api
Comments 1
3 min read
We cut a Lambda bill 96.5% by fixing a retry storm.
votiakov profile

We cut a Lambda bill 96.5% by fixing a retry storm.

#aws #serverless #devops #cloud
Comments
4 min read
Stop writing a parser per site. Run five and let confidence decide.
votiakov profile

Stop writing a parser per site. Run five and let confidence decide.

#webscraping #javascript #webdev
8
Comments
3 min read
Most company job boards are just a public JSON API you can GET
votiakov profile

Most company job boards are just a public JSON API you can GET

#webscraping #api #javascript #jobs
1
Comments
5 min read
Reading Google Play and App Store reviews straight from their JSON, no browser
votiakov profile

Reading Google Play and App Store reviews straight from their JSON, no browser

#webscraping #javascript #api #node
Comments 2
5 min read
Stop parsing HTML to get product data — the JSON is already in the page
votiakov profile

Stop parsing HTML to get product data — the JSON is already in the page

#webscraping #ecommerce #javascript #api
2
Comments 2
4 min read
Google Trends will 429 you into the ground — here's how I got past it
votiakov profile

Google Trends will 429 you into the ground — here's how I got past it

#webscraping #python #javascript #seo
3
Comments 3
5 min read
loading...