BLIMP: Adding null prompt and dropping order swapped prompts - #829

Open

najoungkim wants to merge 16 commits into

bigscience-workshop:eval-hackathonfrom

Urmish:urmish/blimp

Commits on Apr 25, 2022

First 2 prompts for blimp
Urmish
committed
3272924
Fixed some template issues that led to conflicting details
Urmish
committed
74450d7
Updated templates to avoid packing errors
Urmish
committed
b6f01db
Added 2 new prompts with a different style of asking question
Urmish
committed
0a1689c
Add Najoung\'s templates
cookie
committed
f651092
Added prompts for complex_NP_island
Urmish
committed
de16aa3
Updated the templates after the requested fixes
Urmish
committed
ef823c4

Commits on Apr 26, 2022

Added templates for complex_NP_island via copy scripts
Urmish
committed
1cd898e
Updated templates for all subsets
Urmish
committed
a431749
Switched to randomized prompts.
cookie
committed
30a1cda
Minor changes to prompt names
najoungkim
committed
4f7f515
Fix answer_choices for some templates + better template names
najoungkim
committed
52d4d1b
Fixed extra spaces.
najoungkim
committed
e91b438

Commits on Apr 27, 2022