RRPO: ReRanking Preference Optimization This repository contains the official implementation of RRPO (ReRanking Preference Optimization). Work in Progress