This will be easy to integrate with https://github.com/jdm/highfive to automatically report test failures to the PR when they occur.

Relevant prior art for dissecting logs: https://dxr.mozilla.org/mozilla-central/source/testing/mozbase/mozlog/mozlog/scripts/unstable.py