You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Daoud Clarke edited this page Jan 23, 2022
·
1 revision
Web Crawler Extension
Mwmbl provides a web crawler browser extension that volunteers can use to help us crawl the web.
No personal information is collected from your browser
No search or browsing history is accessed
No IP address is recorded
The extension crawls the web starting with a set of seed domains that are highly ranked by Hacker News users
After retrieving the HTML files, content is extracted, batched, and sent to our central server
We store a random unique ID that is stored locally with the extension and sent with the browser. This is used to help detect spam from malicious users.