OpenRefine is a free, open source power tool for working with messy data and improving it

1️⃣🐝🏎️ The One Billion Row Challenge -- A fun exploration of how quickly 1B rows from a text file can be aggregated with Java

Enso Analytics is a self-service data prep and analysis platform designed for data teams.

Yahoo! Cloud Serving Benchmark

Apache Nutch is an extensible and scalable web crawler

Web-Scale Open Information Extraction

Clear implementation of arithmetic coding for educational purposes in Java, Python, C++.

Mojang's Humble bundle source

Huge Collections for Java using efficient off heap storage

Unsupervised Statistical Machine Translation

Java implementation of a probabilistic set data structure

A virtual pet that helps you raise your TDD practice.

playing around with the common crawl dataset

An AWS SDK-backed FileSystem driver for Hadoop

NLP Utilities in Java

Hadoop jobs for WikiReverse project. Parses Common Crawl data for links to Wikipedia articles.

CommonCrawl Hello World example

Stipple Image and TSP-Art Generator for Processing

CommonCrawl Test version of Nutch