GeorgeCarpenter

Results 7 comments of GeorgeCarpenter

some question about the dataset

What are the datasets of all the pretrained models?

Should we evaluate the performance on all the files in the dataset or just a single file is enough?

> Thanks for the question. Actually these files are for different providers, the code will automatically choose the corresponding one accroding to your code, and you don't need to to...

What is the least VRAM Requirements?

> Hi， would you please specify the model you're deploying? The model I have used is ByteDance-Seed/UI-TARS-7B-DPO @Taoran-Lu

Error code: 400 - {'object': 'error', 'message': 'Conversation roles must alternate user/assi stant/user/assistant/...', 'type': 'BadRequestError', 'param': None, 'code': 400}

> Could you provide the full traceback? ``` Traceback (most recent call last: [24/1888] File "/mnt/code/llm_/agent_s/OSWorld/run_agents2.py", line 371, in test(args, test_file_list) File "/mnt/code/llm_/agent_s/OSWorld/run_agents2.py", line 263, in test raise e File...

Error code: 400 - {'object': 'error', 'message': 'Conversation roles must alternate user/assi stant/user/assistant/...', 'type': 'BadRequestError', 'param': None, 'code': 400}

The bug occurred when processing the task `chrome/e1e75309-3ddb-4d09-92ec-de869c928143`

Error code: 400 - {'object': 'error', 'message': 'Conversation roles must alternate user/assi stant/user/assistant/...', 'type': 'BadRequestError', 'param': None, 'code': 400}

Do you have some ideas? Maybe we can fix the bug togather. @alckasoc

Error code: 400 - {'object': 'error', 'message': 'Conversation roles must alternate user/assi stant/user/assistant/...', 'type': 'BadRequestError', 'param': None, 'code': 400}

> It seems like the `reflection_agent`'s `messages` has 2 consecutive user messages. I haven't had issues with this, but I'll test this again. > > EDIT: I didn't get this...