ColossalAI icon indicating copy to clipboard operation
ColossalAI copied to clipboard

In this code line - trainer.fit(dataset, ...), What is the dataset need to be considered.

Open Pradeep-Vanapalli opened this issue 2 years ago • 2 comments

🐛 Describe the bug

I am running the code in the NaiveStrategy and trying to train by giving the dataset path as "ChatGPT/chatgpt/dataset/". But it is throwing the error as "Ellipsis object cannot be interpreted as an integer".

When I am trying to pass as follows, trainer.fit('ChatGPT/chatgpt/dataset/', 5) It is throwing error as "unsupported type " And the value for the inputs taking is ['a', 'o', 't', 'd', 'c', '/', 't', '/'].

Please suggest if it is related dataset need to be take or any other thing.

Environment

No response

Pradeep-Vanapalli avatar Mar 08 '23 10:03 Pradeep-Vanapalli

you can refer the datasets we use to build your own datasets:https://huggingface.co/datasets/Anthropic/hh-rlhf

Fazziekey avatar Mar 09 '23 03:03 Fazziekey

Thank You @Fazziekey for the prompt response...!!!

I used the same dataset but still facing below error. TypeError: 'ellipsis' object cannot be interpreted as an integer

In the code line trainer.fit(dataset, ...), What is the meaning of "..."

Pradeep-Vanapalli avatar Mar 09 '23 06:03 Pradeep-Vanapalli

Hi @Pradeep-Vanapalli We have updated a lot. Please check the latest code. This issue was closed due to inactivity. Thanks.

binmakeswell avatar Apr 27 '23 10:04 binmakeswell