Siqi Liang

icon indicating a website link https://agentds.github.io/

icon company University of Michigan icon location Ann Arbor icon location ILLIDAN Lab @ UMSI, PhD student of Information; USC, master of CS; SMILE Lab

Results 2 issues of Siqi Liang

little mistake when calculate the perplexity

1 comment

In [__get_ppl()](https://github.com/Shark-NLP/OpenICL/blob/1613ae10b88ba2dbfed425c4ee078b2a6586152e/openicl/icl_inferencer/icl_ppl_inferencer.py#L164) of `PPLInferencer`, at [line 186](https://github.com/Shark-NLP/OpenICL/blob/1613ae10b88ba2dbfed425c4ee078b2a6586152e/openicl/icl_inferencer/icl_ppl_inferencer.py#L186) ```python lens = (inputs["input_ids"] != self.tokenizer.pad_token_id).sum(-1).cpu().numpy() ``` where it tries to calculate the token number of each text sample in `input_texts`, by count...

add non_blocking=False args to support transformers>=4.48.0

add non_blocking arg in `ListWrapper.to` to support `transformers>=4.48.0`. For `transformers "BatchEncoding": """ Send all values to device by calling `v.to(device)` (PyTorch only). Args: device (`str` or `torch.device`): The device to...