Repositories list

• awesome-web-archiving

  Public
  An Awesome List for getting started with web archiving

  awesomeawesome-listwebarchiving

  awesomeawesome-listwebarchiving

  Creative Commons Zero v1.0 Universal

  •182•2.5k•4•2•Updated Mar 18, 2026Mar 18, 2026

• robustlinks

  Public
  Links on the web break all the time, robustify them!

  javascripthtmllinks+ 2

  javascripthtmllinkswebarchivesrobust-links

  JavaScript

  •7•58•2•1•Updated Mar 5, 2026Mar 5, 2026

• webarchive-commons

  Public
  Common web archive utility code.

  Java

  •

  Apache License 2.0

  •76•63•14•4•Updated Mar 2, 2026Mar 2, 2026

• jwarc

  Public
  Java library for reading and writing WARC files with a typed API

  Java

  •

  Apache License 2.0

  •14•55•18•0•Updated Feb 26, 2026Feb 26, 2026

• warc-specifications

  Public
  Centralised repository for WARC usage specifications.

  HTML

  •34•125•48•1•Updated Oct 12, 2025Oct 12, 2025

• warc2html

  Public
  Converts WARC files to static HTML

  Java

  •

  Apache License 2.0

  •7•51•5•0•Updated Sep 18, 2025Sep 18, 2025

• warcaroo

  Public
  Java

  •

  Apache License 2.0

  •1•17•5•0•Updated Apr 19, 2025Apr 19, 2025

• javaswf

  Public
  Fork of JavaSWF2 for building Heritrix

  Java

  •

  Other

  •1•3•0•0•Updated Oct 17, 2024Oct 17, 2024

• openwayback

  Public
  The OpenWayback Development

  Java

  •

  Apache License 2.0

  •307•516•100•5•Updated Jan 3, 2024Jan 3, 2024

• openwayback-access-control

  Public
  web access control (exclusion oracle) tools for optional use with wayback machine

  JavaScript

  •

  Apache License 2.0

  •6•9•0•7•Updated Jan 2, 2023Jan 2, 2023

• logtrix

  Public
  Java library/tool for parsing and summarising Heritrix crawl logs

  Java

  •

  Apache License 2.0

  •2•6•3•3•Updated Nov 16, 2022Nov 16, 2022

• urlcanon

  Public
  url canonicalization library for python and java

  Java

  •7•39•4•0•Updated May 22, 2022May 22, 2022

• heritrix-dependencies

  Public
  Dependencies needed to build Heritrix that aren't in Maven Central

  1•3•0•0•Updated Sep 1, 2021Sep 1, 2021

• training

  Public
  Inventory of Web Archiving Training Resources

  1•8•0•0•Updated Oct 24, 2019Oct 24, 2019

• archive-crawler-yg-archive

  Public
  An 'archive' of the Yahoo-hosted archive-crawler group

  2•7•0•0•Updated Oct 17, 2019Oct 17, 2019

• qa2019

  Public
  Resources for the 2019 IIPC QA hackathon

  HTML

  •3•6•14•0•Updated May 3, 2019May 3, 2019

• crawl-recipes

  Public
  A place to share practical bits of crawling experiences

  Apache License 2.0

  •1•4•0•0•Updated Dec 12, 2018Dec 12, 2018

• iipc.github.io

  Public
  IIPC Open Development

  Apache License 2.0

  •3•10•0•0•Updated Jun 16, 2017Jun 16, 2017

• travis

  Public
  Shared config for Travis CI for IIPC.

  Shell

  •

  Apache License 2.0

  •2•4•0•0•Updated May 3, 2017May 3, 2017

• heritrix3

  Public
  Heritrix is the Internet Archive's open-source, extensible, web-scale, archival-quality web crawler project.

  Java

  •781•11•0•1•Updated Mar 9, 2017Mar 9, 2017

• cdx-cli

  Public
  Command line utility for working with CDX files

  Java

  •

  Apache License 2.0

  •3•5•0•0•Updated Sep 29, 2016Sep 29, 2016

• iipc-parent

  Public
  IIPC Parent POM

  Apache License 2.0

  •1•4•0•0•Updated May 24, 2016May 24, 2016

• twittervane

  Public archive
  Using social media to steer web archiving and curation.

  JavaScript

  •4•18•1•0•Updated Nov 20, 2015Nov 20, 2015

• openwayback-sample-overlay

  Public
  Sample Wayback Config using OpenWayback

  6•6•0•0•Updated Feb 7, 2014Feb 7, 2014