Align data collators across DPO / SFT / Reward / KTO#6178

qgallouedec wants to merge 3 commits into

mainhuggingface/trl:mainfrom

align-collatorshuggingface/trl:align-collatorsCopy head branch name to clipboard