Delays mailing of errors so that we can see if any other errors occur within a short time span.

Requires Celery and some sort of cache, preferably memcache.