When installing through the latest published helm chart (which aligns with the helm chart contents found in the repo), you get a non-recent version (2.0.20-all).

This also doesn't align with the values.yaml file. Found this out as workload identity federation is only enabled in 2.0.23, while helm installs 2.0.20 (and the latest is 2.0.28 when I write this). But the values file states that leaving the key file empty will enable workload identity federation ...

Fixed this with setting the image tag myself to the latest version.