LLMeBench icon indicating copy to clipboard operation
LLMeBench copied to clipboard
verified publisher icon qcri

Issue with OSACT4SubtaskB dataset loading

Open AridHasan opened this issue 1 year ago • 0 comments

File: llmebench/datasets/OSACT4SubtaskB.py Line: 44 If we take the first two as text and label, the labels are ["HS", "NOT_HS", "OFF", "NOT_OFF"]. The "OFF" and "NOT_OFF" labels are for subtaskA.

the line 44 would be:

text, _, label = line.split("\t")

AridHasan avatar May 13 '24 02:05 AridHasan