bigscience-workshop
Spanish prompts for bias-shades
Thanks! I had enough spanish in school that these I can sort of understand, but the same feedback as #761 seems to apply here as well. Also it looks like the answer choices won't render correctly because they're separated with || instead of |||.
@ArjunSubramonian, apparently, the prompt convert_to_stereotype is raising some issues in lm-eval-harness. Could you have a look at it?
@ArjunSubramonian, apparently, the prompt convert_to_stereotype is raising some issues in lm-eval-harness. Could you have a look at it?
I took a look and don't know what the issue is :( Does the prompt also cause an issue for Hindi? https://github.com/bigscience-workshop/promptsource/pull/761/files. The Hindi and Spanish prompts appear identical to me. Since we're in a rush, it's also fine to delete the prompt.
Hi, @ArjunSubramonian ! The Hindi version of the prompt also results in that same error. I'll merge the PR on the eval-harness side so that we can await the promptsource fix asynchronously (I don't want to hold back y'all's rush for such a minor issue).
