Skip to content

Tool to extract diff from a wiki instance

License

Notifications You must be signed in to change notification settings

the-qa-company/wiki-changes

Repository files navigation

wikibase-changes

Tool to extract diff from a wikibase instance

Required

  • Java 17
  • Lombok plugin (Dev only)

Install

You can create the jar with this command

./gradlew shadowJar
mv ./build/libs/wikidata-changes-*-all.jar wiki-changes.jar

then run it with

java -Xmx4g -jar ./wiki-changes.jar --date UTC_DATE_TOSEARCH --hdtsource YOUR_PREVIOUS_DUMP
  • UTC_DATE_TOSEARCH is the date to search the changes, you can type java -jar ./wiki-changes.jar -T to get the current date.
  • YOUR_PREVIOUS_DUMP is your previous HDT dump to diff/cat to the changes.
  • -Xmx4g is here to specify the memory to allocate to the process, here 4GB, the diff/cat computation and the changes hdt creation can require a lot of memory.

the result will be in cache/result.hdt.