Install pip -r requirements.txt in a new venv before running any of the below.

To grab all 55,000,000 games (please don't do this, just download the public JSON dump I already provide)

    python get_public.py

To process the database into the JSON dump (available for download here)

    python output-json.py

To process the JSON dump into .tar.gz files full of SGFs (available for download here), run

    python output.py # uses: ogstosgf.py

Please feel free to submit improvement patches or bug reports on github

Additional files:

• ogstosgf.py: converts one JSON record to one SGF game
• game-blacklist.txt: known problem games in OGS
• user-blacklist.txt: these players are robots, so we exclude their (very large) list of games in the SGF bundles