Omar Mahhmoud

icon indicating a website link https://www.linkedin.com/in/omarmohamed88/

icon company [email protected] icon location Melbourne, Australia icon location PhD Student @ A²I² - Applied Artificial Intelligence Institute-Deakin univ

Results 6 comments of Omar Mahhmoud

unexpected results in inference

i tried it and still get the same unexpected results, I am running on collab and the installation is talking to much to building the wheel. here is the installation...

unexpected results in inference

it doesn't output any text just "^C" ![image](https://github.com/mosaicml/llm-foundry/assets/45721757/fe1a656d-be3f-4b41-93c2-1f55b3c678de)

Possible to load huggingface's pretrained models in anchor_llm & augment_llm?

@lucidrains any solution for this issue?

Issue with eos_token_id in LanguageModel.generate() when using local models

@zzn-nzz Have u found a solution for this issue?

TypeError: LlamaSdpaAttention.forward() got an unexpected keyword argument 'truthx_model'

@XavierZhang2002 @GuoqingWang1 ,I got the same error and tried to set the attention to eager mode, but still facing the same issue. ``` import torch from transformers import AutoTokenizer, AutoModelForCausalLM...

IndexError

The inputs is inputs_ids which is 100 tokens Idx is a list of tokens index of the tokens that i want apply the patch on them , for example [2,10,50,44]