flair/mastermind_24_mcq_random
Viewer • Updated • 30.4k • 361
MastermindEval
Prompting and multiple-choice (MCQ) benchmarks to evaluate reasoning capabilities of LLMs using Mastermind.
-
-
flair/mastermind_35_mcq_random
Viewer • Updated • 37.1k • 66 -
flair/mastermind_46_mcq_random
Viewer • Updated • 36.1k • 346 -
flair/mastermind_24_mcq_close
Viewer • Updated • 30.4k • 79 -
flair/mastermind_35_mcq_close
Viewer • Updated • 37.1k • 102 -
flair/mastermind_46_mcq_close
Viewer • Updated • 36.1k • 140 -
flair/mastermind_24_prompt
Viewer • Updated • 30.4k • 42 -
flair/mastermind_35_prompt
Viewer • Updated • 37.1k • 31 -
flair/mastermind_46_prompt
Viewer • Updated • 36.1k • 29 -
MastermindEval: A Simple But Scalable Reasoning Benchmark
Paper • 2503.05891 • Published • 1 -
flair/mastermind_57_mcq_random
Viewer • Updated • 1.23k • 49 -
flair/mastermind_57_mcq_close
Viewer • Updated • 1.23k • 47 -
flair/mastermind_68_mcq_random
Viewer • Updated • 1.27k • 47 -
flair/mastermind_68_mcq_close
Viewer • Updated • 1.27k • 49 -
flair/mastermind_57_prompt
Viewer • Updated • 3.13k • 26 -
flair/mastermind_68_prompt
Viewer • Updated • 3.16k • 27