Hyunsoo Luke HA

icon indicating a website link https://www.linkedin.com/in/hyunsoo-ha-872aaa134/ icon indicating an email [email protected]

icon company @UpstageAI icon location Seoul, Republic Of Korea icon location AI Research Engineer at Upstage. Previously researched OCR. Currently handling various data tasks in the Data-Centric LLM team for training Upstage Solar LLM.

Results 3 comments of Hyunsoo Luke HA

Fix torch.clamp issue #237

@ancientmooner Could you please check issue #237 ?

Fix torch.clamp issue #237

@juncgu Thanks for your suggestion. I have modified the code as the second option. Could you please take a look at this PR? @ancientmooner

Validate tokenizer and model alignment before training

> sorry for [#2074 (comment)](https://github.com/pytorch/torchtitan/pull/2074#discussion_r2587695418) > > I mean for that particular `eos_id` change in hf_transformers -- we should still remove others, could you add the changes back? @tianyu-l No...