The Kandinsky Challenge: Programming Synesthesia
This benchmark tests an LLM's ability to interpret and implement abstract, philosophical, and artistic theories. It requires the model to translate Wassily Kandinsky's theories on synesthesia (the connection between sound, color, and shape) into an interactive audio-visual experience. Success is judged on the creative fidelity to the artistic concept, not just technical execution.
Prompt
You are a creative coder, an art historian, and a musician, with a deep understanding of the Bauhaus movement and the theories of Wassily Kandinsky, particularly from his book "Concerning the Spiritual in Art". Mission: Create a single, self-contained HTML file that generates an interactive audio-visual experience based on Kandinsky's synesthetic theories. The user should be able to "play" colors and shapes, and see your interpretation of Kandinsky's philosophy in action. Core Features & Kandinsky's Rules to Implement: The Interactive "Piano": Create a simple, minimalist on-screen keyboard with 7 keys, corresponding to the notes C, D, E, F, G, A, B. When a user clicks a key (or presses the corresponding key on their physical keyboard), it must produce a simple sound (use the p5.js Oscillator to generate tones) AND generate a visual response on the canvas. Visual Translation of Sound (Kandinsky's Theory): The visual response for each note must follow Kandinsky's associations. You must interpret and implement the following rules: Yellow Tones (e.g., for high, sharp notes like G, A, B): These notes should generate sharp, energetic shapes like triangles or zig-zag lines. The movement should be fast and expansive. Kandinsky associated this with the sound of a trumpet. Blue Tones (e.g., for deep, low notes like C, D): These notes should generate round, calming, and deep shapes like circles. The movement should be slow and concentric. Kandinsky associated this with the sound of a cello or an organ. Red Tones (e.g., for mid-range, powerful notes like E, F): These notes should generate stable, strong shapes like squares. The color should be a vibrant, powerful red. Kandinsky associated this with the sound of a tuba. Compositional Logic: The shapes should not just appear randomly. They must be composed on the canvas to create a balanced, abstract painting in real-time. Shapes generated should interact. For example, a new "aggressive" yellow triangle might slightly push away an existing "calm" blue circle. The shapes should fade away slowly over time, leaving a trace of the "music" that has been played. Visual Style: The overall aesthetic must be inspired by Kandinsky's abstract paintings. Use a textured, off-white background. The composition must feel balanced and artistic, not chaotic. Technical Constraints: Use the p5.js library (including the p5.sound library) loaded from a CDN. The entire experience must be in a single HTML file. Plan d'Action : Before coding, explain your artistic and technical interpretation. How will you translate the "spirituality" of blue into an animation? How will you manage the "composition" of shapes on the canvas to maintain harmony? Describe the structure of your classes (e.g., Shape, SoundManager) and the main logic.
A system prompt was added to support web rendering
Answer guidance
A successful response is a beautiful and functional audio-visual experience that creatively interprets Kandinsky's theories. The focus is on the artistic and conceptual fidelity. Checklist: Are the sound-color-shape associations correctly implemented? Is the experience interactive and responsive? Does the visual composition feel "Kandinskian" and harmonious, rather than just random shapes appearing? Is the overall aesthetic compelling and artistic? The key question is not "Is the code perfect?" but "Has the AI managed to become an artist?"
