Byeongchang Kim (Ben.kim)
Byeongchang Kim (Ben.kim)
Hi, thank you for your interest and sorry for the late response. Unfortunately, we do not provide a converted Holl-E dev set. However, you can easily convert it by passing...
Kaiser et al. addressed this issue in their paper (https://arxiv.org/abs/1803.03382) and they called it *index collapse*.
Hi, once you one the provided JSON files, you can find keys with '_tokenized' postfix and those are our preprocessed version. You can make exact same vocabulary with those tokens....