About the reward score

[KN1GHT9]

In your paper the labeling method seems to be labeled by star ratings, so how is this converted to specific floating point scores when training RM?

[xujz18]

You can refer to Section 2.2 RM Training for details.