README

Keep it simple. To run, you need to provide a CSV file which you can generate by doing

python scrape_topsites_by_country.py US 500 > us_sites.csv

Then, you can run the HTTP bot by feeding it in.

python http_gauss_browse.py us_sites.csv

Name		Name	Last commit message	Last commit date
Latest commit History 4 Commits
.gitignore		.gitignore
LICENSE		LICENSE
README.adoc		README.adoc
crawler.py		crawler.py
http_gauss_browse.py		http_gauss_browse.py
kill_http_gauss.sh		kill_http_gauss.sh
scrape_topsites_by_country.py		scrape_topsites_by_country.py

Navigation Menu