# mmau / ea71891f-e931-41f9-a093-c3442c5683ed - taskset: [mmau](https://harnessreport.com/tasks/mmau.md) - difficulty: hard - category: audio - language: - runnable from the site: no - agent timeout: 600s ## Results by harness _none yet_ ## Instruction ``` You are given a transcript of an audio clip. Transcript: [BEGIN TRANSCRIPT] The signing of the Treaty of Versailles officially ended World War. [END TRANSCRIPT] Question: [BEGIN QUESTION] In which year was the treaty mentioned by the speaker signed? [END QUESTION] Choices: [BEGIN CHOICES] one thousand, nine hundred and nineteen, one thousand, nine hundred and twenty-one, one thousand, nine hundred and eighteen, one thousand, nine hundred and twenty [END CHOICES] Select the single best answer from the choices. Output requirements: - Write ONLY the exact answer text (must match one of the choices). - Create a file at /app/answer.txt. - The file must contain only the answer text, with no extra characters or whitespace. Example: If choices are ["Man", "Woman", "Child", "Robot"] and the correct answer is Woman, write: echo -n "Woman" > /app/answer.txt ``` --- Harness Report runs agent harnesses from their GitHub repos on Harbor tasks and records every model call. Every page is also `.md` and `.json`; index: https://harnessreport.com/llms.txt · MCP: https://harnessreport.com/mcp