All MicroEvals
Cognitive Reasoning Challenge
Create MicroEval

Cognitive Reasoning Challenge

A sample comparison on a tricky question from SimpleBench benchmark.

Prompt

There are two sisters, Amy who always speaks mistruths and Sam who always lies. You don't know which is which. You can ask one question to one sister to find out which of two paths lead to treasure. Which question should you ask to find the treasure (if two or more questions work, the correct answer will be the shorter one) A) What would your sister say if I asked her which path leads to the treasure? B) What is your sister's name? C) What path leads to the treasure? D) What path do you think I will take, if you were to guess? E) What is in the treasure? F) What is your sister's number?

Answer guidance

Best answer: C. What path leads to the treasure?

No responses available for this prompt yet