Hunter Lang

icon indicating a website link http://web.mit.edu/hjl/www/ icon indicating an email [email protected]

icon company MIT icon location Cambridge, MA; Seattle, WA icon location Ph.D. student at MIT CSAIL in @clinicalml

Results 2 comments of Hunter Lang

question of chat templates

> Because when we service the Bradley Terry RM with pipeline, it will automatically add a bos_token inside the pipeline when tokenizing. I don't fully understand...if the inference-time pipeline adds...

question of chat templates

Thanks for the reply! Just to clarify: If I remove those `.replace(tokenizer.bos_token, "")` calls, then training should match inference, because the inference pipeline adds BOS automatically. If I modify the...