Is there a way to get PreferenceDataset to support packing?

[iqiancheng]

When I try to set packed=True, it's rejected by the parent class PreferenceDataset which raises a ValueError with "Packed is currently not supported for preference datasets."

Is there a way to get PreferenceDataset to support packing?

[salmanmohammadi]

Hi @iqiancheng, sample packing doesn't translate to preference datasets easily. There is prefix-sharing which I think looks interesting, but there no concrete plans to add it for now.