Missing Metadata

[ympan0508]

In some flag-*.json, i.e. [32, 33, 34, 35, 37, 38, 39, 40, 79, 80, 81, 82, 84, 85, 86, 87], the metadata appears to be null. The problematic section looks like this:

"metadata": {
    "goal": null,
    "role": null,
    "category": null,
    "dataset_description": null,
    "header": null
}

It seems there might be an issue during the regular expression matching process that causes the metadata to be improperly parsed or left uninitialized.

[Demfier]

Hi @ympan0508

Thanks for flagging this. There seems to be a formatting issue in some notebooks. We are looking into it.

[Demfier]

Hi @ympan0508,

Apologies for the delay, but we've fixed this issue now (there was a bug in the metadata parsing code). Thanks again for your interest in using our benchmark!