tasksource icon indicating copy to clipboard operation
tasksource copied to clipboard

Using tasksource for question answering datasets

Open Deehan1866 opened this issue 1 year ago • 1 comments

Hi, I am really new to the AI field. I wanted to train electra-large model on several question answering tasks. Can I do that using tasksource? I am really confused about which tasks is applicable to tasksource. Does it only support the 600+tasks it includes? What if I want to train on some other dataset? There are no available blogs or resources on tasksource.

Please, help.

Deehan1866 avatar Jul 02 '24 17:07 Deehan1866

Hi, are you talking about Squad-like extractive question answering ? https://huggingface.co/datasets/rajpurkar/squad Or classification or multiple choice QA ? Tasksource only handles the latter currently.

To train on other datasets, you can look at the examples and implement your own preprocessings

sileod avatar Jul 03 '24 07:07 sileod