MicroEvals
Public evaluations
Showing 141-160 of 2502
physics test
An visual IQ test generator
This MicroEval evaluates LLM responses to simple logic-based questions that LLMs commonly get wrong. The problems used in this MicroEval are from the ArXiv paper of the same name: https://arxiv.org/abs/2405.19616. It is by Sean Williams and James Huckle, so props to them for developing this experiment all the way back in 2024.
Test models' ability to count the number of moves in a given chess position
THE LAKEFRONT ESTATE MAROS
Testing knowledge of Czech culture and language - designed to test smaller models based on https://semanticmachines.notion.site/evals
Write a tweet-length sci-fi story
Glasses of wine are traditionally only half-full.
12 prompts sampling FSC architecture, engineering, discovery, security, and migration scenarios for model comparison.
A set of difficult tasks with the theme of emoji's including: tier list creation, music creation and, themeable website creation.
make a single html in which the world globe is there (do not svg map) and the map is highlighted in a glow while line all around borders of countries and it will be in dark mode and make the globe 3d and good looking and interactive with satellites roaming around with dotted path make sure it works . let me be very clear 1. I want full black earth, land will be in a very dark grey colour , and ocean must be black. The add a white outline to every country borders. 2. Try to make code as much ad low bugs possible. Add a feature when we tap any country it open slides up a info card containing all info about that country. Keep ui of that in transulent black. And cover all countries