Owain Davies
Results
3
comments of
Owain Davies
FYI, the last warning still appears on `main` but has been addressed upstream :).
@encukou @picnixz Thanks! Your suggestions/changes LGTM!
I can reproduce the performance gains of using a pre-initialized BPE. In fact, it would be possible to implement something like a `num_tokens_from_messages_cached_bpe` that does the initialization of the two...