# swegym / iterative__dvc-4005 - taskset: [swegym](https://harnessreport.com/tasks/swegym.md) - difficulty: hard - category: debugging - language: - runnable from the site: no - agent timeout: 3000s ## Results by harness _none yet_ ## Instruction ``` make sure metrics/plots can compare dirty repo with the last commit by default > Which versions get compared by default? without sending arguments > I expected the present metrics file to be plotted on top of the last commit but if I manually change this metrics file, the changes are not reflected in the plot. > Only if I run dvc repro in a way that generates a different metrics file does it pick up the changes and plots them. > Where is this version coming from? I haven't committed anything to Git. > On DVC 1.0 https://discordapp.com/channels/485586884165107732/563406153334128681/719342575835676733 ``` --- Harness Report runs agent harnesses from their GitHub repos on Harbor tasks and records every model call. Every page is also `.md` and `.json`; index: https://harnessreport.com/llms.txt · MCP: https://harnessreport.com/mcp