# crustbench - domain: swe - n_tasks: 100 - n_runnable: 3 ## Tasks | task | difficulty | language | runnable | harnesses tried | |---|---|---|---|---| | [crustbench-2dpartint](https://harnessreport.com/tasks/crustbench/crustbench-2dpartint.md) | easy | | | 0 | | [crustbench-42-kocaeli-printf](https://harnessreport.com/tasks/crustbench/crustbench-42-kocaeli-printf.md) | easy | | | 0 | | [crustbench-aes128-simd](https://harnessreport.com/tasks/crustbench/crustbench-aes128-simd.md) | hard | | | 0 | | [crustbench-amp](https://harnessreport.com/tasks/crustbench/crustbench-amp.md) | easy | | | 0 | | [crustbench-approxidate](https://harnessreport.com/tasks/crustbench/crustbench-approxidate.md) | easy | | | 0 | | [crustbench-avalanche](https://harnessreport.com/tasks/crustbench/crustbench-avalanche.md) | easy | | | 0 | | [crustbench-bhshell](https://harnessreport.com/tasks/crustbench/crustbench-bhshell.md) | medium | | | 0 | | [crustbench-bigint](https://harnessreport.com/tasks/crustbench/crustbench-bigint.md) | easy | | yes | 0 | | [crustbench-bitset](https://harnessreport.com/tasks/crustbench/crustbench-bitset.md) | easy | | | 0 | | [crustbench-blt](https://harnessreport.com/tasks/crustbench/crustbench-blt.md) | medium | | | 0 | | [crustbench-bostree](https://harnessreport.com/tasks/crustbench/crustbench-bostree.md) | easy | | | 0 | | [crustbench-btree-map](https://harnessreport.com/tasks/crustbench/crustbench-btree-map.md) | easy | | | 0 | | [crustbench-c-aces](https://harnessreport.com/tasks/crustbench/crustbench-c-aces.md) | hard | | | 0 | | [crustbench-c-blind-rsa-signatures](https://harnessreport.com/tasks/crustbench/crustbench-c-blind-rsa-signatures.md) | easy | | | 0 | | [crustbench-c-string](https://harnessreport.com/tasks/crustbench/crustbench-c-string.md) | easy | | | 0 | | [crustbench-carrays](https://harnessreport.com/tasks/crustbench/crustbench-carrays.md) | easy | | | 0 | | [crustbench-cfsm](https://harnessreport.com/tasks/crustbench/crustbench-cfsm.md) | easy | | | 0 | | [crustbench-chtrie](https://harnessreport.com/tasks/crustbench/crustbench-chtrie.md) | easy | | | 0 | | [crustbench-circularbuffer](https://harnessreport.com/tasks/crustbench/crustbench-circularbuffer.md) | easy | | | 0 | | [crustbench-cissy](https://harnessreport.com/tasks/crustbench/crustbench-cissy.md) | medium | | | 0 | | [crustbench-cjson](https://harnessreport.com/tasks/crustbench/crustbench-cjson.md) | easy | | | 0 | | [crustbench-clhash](https://harnessreport.com/tasks/crustbench/crustbench-clhash.md) | easy | | | 0 | | [crustbench-clog](https://harnessreport.com/tasks/crustbench/crustbench-clog.md) | easy | | yes | 0 | | [crustbench-coroutine](https://harnessreport.com/tasks/crustbench/crustbench-coroutine.md) | easy | | | 0 | | [crustbench-cset](https://harnessreport.com/tasks/crustbench/crustbench-cset.md) | easy | | | 0 | | [crustbench-csyncmers](https://harnessreport.com/tasks/crustbench/crustbench-csyncmers.md) | easy | | | 0 | | [crustbench-dict](https://harnessreport.com/tasks/crustbench/crustbench-dict.md) | easy | | | 0 | | [crustbench-emlang](https://harnessreport.com/tasks/crustbench/crustbench-emlang.md) | hard | | | 0 | | [crustbench-expr](https://harnessreport.com/tasks/crustbench/crustbench-expr.md) | easy | | | 0 | | [crustbench-fasthamming](https://harnessreport.com/tasks/crustbench/crustbench-fasthamming.md) | easy | | | 0 | | [crustbench-fft](https://harnessreport.com/tasks/crustbench/crustbench-fft.md) | easy | | | 0 | | [crustbench-file2str](https://harnessreport.com/tasks/crustbench/crustbench-file2str.md) | easy | | | 0 | | [crustbench-fleur](https://harnessreport.com/tasks/crustbench/crustbench-fleur.md) | easy | | | 0 | | [crustbench-fs-c](https://harnessreport.com/tasks/crustbench/crustbench-fs-c.md) | easy | | | 0 | | [crustbench-fslib](https://harnessreport.com/tasks/crustbench/crustbench-fslib.md) | hard | | | 0 | | [crustbench-genetic-neural-network-for-simple-control](https://harnessreport.com/tasks/crustbench/crustbench-genetic-neural-network-for-simple-control.md) | hard | | | 0 | | [crustbench-geofence](https://harnessreport.com/tasks/crustbench/crustbench-geofence.md) | easy | | yes | 0 | | [crustbench-gfc](https://harnessreport.com/tasks/crustbench/crustbench-gfc.md) | easy | | | 0 | | [crustbench-gorilla-paper-encode](https://harnessreport.com/tasks/crustbench/crustbench-gorilla-paper-encode.md) | easy | | | 0 | | [crustbench-graph-recogniser](https://harnessreport.com/tasks/crustbench/crustbench-graph-recogniser.md) | medium | | | 0 | | [crustbench-hamta](https://harnessreport.com/tasks/crustbench/crustbench-hamta.md) | easy | | | 0 | | [crustbench-holdem-odds](https://harnessreport.com/tasks/crustbench/crustbench-holdem-odds.md) | hard | | | 0 | | [crustbench-hydra](https://harnessreport.com/tasks/crustbench/crustbench-hydra.md) | easy | | | 0 | | [crustbench-impcheck](https://harnessreport.com/tasks/crustbench/crustbench-impcheck.md) | hard | | | 0 | | [crustbench-inversion-list](https://harnessreport.com/tasks/crustbench/crustbench-inversion-list.md) | easy | | | 0 | | [crustbench-jccc](https://harnessreport.com/tasks/crustbench/crustbench-jccc.md) | hard | | | 0 | | [crustbench-kairocompiler](https://harnessreport.com/tasks/crustbench/crustbench-kairocompiler.md) | hard | | | 0 | | [crustbench-kd3](https://harnessreport.com/tasks/crustbench/crustbench-kd3.md) | easy | | | 0 | | [crustbench-lambda-calculus-eval](https://harnessreport.com/tasks/crustbench/crustbench-lambda-calculus-eval.md) | hard | | | 0 | | [crustbench-leftpad](https://harnessreport.com/tasks/crustbench/crustbench-leftpad.md) | easy | | | 0 | | [crustbench-lib2bit](https://harnessreport.com/tasks/crustbench/crustbench-lib2bit.md) | easy | | | 0 | | [crustbench-libbase122](https://harnessreport.com/tasks/crustbench/crustbench-libbase122.md) | easy | | | 0 | | [crustbench-libbeaufort](https://harnessreport.com/tasks/crustbench/crustbench-libbeaufort.md) | medium | | | 0 | | [crustbench-libfor](https://harnessreport.com/tasks/crustbench/crustbench-libfor.md) | medium | | | 0 | | [crustbench-libm17](https://harnessreport.com/tasks/crustbench/crustbench-libm17.md) | easy | | | 0 | | [crustbench-libpgn](https://harnessreport.com/tasks/crustbench/crustbench-libpgn.md) | hard | | | 0 | | [crustbench-libpsbt](https://harnessreport.com/tasks/crustbench/crustbench-libpsbt.md) | hard | | | 0 | | [crustbench-libqueue](https://harnessreport.com/tasks/crustbench/crustbench-libqueue.md) | easy | | | 0 | | [crustbench-libtinyfseq](https://harnessreport.com/tasks/crustbench/crustbench-libtinyfseq.md) | easy | | | 0 | | [crustbench-libutf](https://harnessreport.com/tasks/crustbench/crustbench-libutf.md) | hard | | | 0 | | [crustbench-libvcd](https://harnessreport.com/tasks/crustbench/crustbench-libvcd.md) | easy | | | 0 | | [crustbench-libwecan](https://harnessreport.com/tasks/crustbench/crustbench-libwecan.md) | easy | | | 0 | | [crustbench-linear-algebra-c](https://harnessreport.com/tasks/crustbench/crustbench-linear-algebra-c.md) | medium | | | 0 | | [crustbench-ljmm](https://harnessreport.com/tasks/crustbench/crustbench-ljmm.md) | easy | | | 0 | | [crustbench-ltre](https://harnessreport.com/tasks/crustbench/crustbench-ltre.md) | medium | | | 0 | | [crustbench-math-library-in-c](https://harnessreport.com/tasks/crustbench/crustbench-math-library-in-c.md) | easy | | | 0 | | [crustbench-matrix-multiplication](https://harnessreport.com/tasks/crustbench/crustbench-matrix-multiplication.md) | medium | | | 0 | | [crustbench-mdb](https://harnessreport.com/tasks/crustbench/crustbench-mdb.md) | medium | | | 0 | | [crustbench-megalania](https://harnessreport.com/tasks/crustbench/crustbench-megalania.md) | hard | | | 0 | | [crustbench-merkle-tree-c](https://harnessreport.com/tasks/crustbench/crustbench-merkle-tree-c.md) | easy | | | 0 | | [crustbench-morton](https://harnessreport.com/tasks/crustbench/crustbench-morton.md) | easy | | | 0 | | [crustbench-murmurhash-c](https://harnessreport.com/tasks/crustbench/crustbench-murmurhash-c.md) | medium | | | 0 | | [crustbench-mvptree](https://harnessreport.com/tasks/crustbench/crustbench-mvptree.md) | medium | | | 0 | | [crustbench-nandc](https://harnessreport.com/tasks/crustbench/crustbench-nandc.md) | easy | | | 0 | | [crustbench-phills-dht](https://harnessreport.com/tasks/crustbench/crustbench-phills-dht.md) | easy | | | 0 | | [crustbench-quadtree](https://harnessreport.com/tasks/crustbench/crustbench-quadtree.md) | medium | | | 0 | | [crustbench-razz-simulation](https://harnessreport.com/tasks/crustbench/crustbench-razz-simulation.md) | medium | | | 0 | | [crustbench-rbtree-lab](https://harnessreport.com/tasks/crustbench/crustbench-rbtree-lab.md) | easy | | | 0 | | [crustbench-recordmanager](https://harnessreport.com/tasks/crustbench/crustbench-recordmanager.md) | hard | | | 0 | | [crustbench-rect-pack-h](https://harnessreport.com/tasks/crustbench/crustbench-rect-pack-h.md) | easy | | | 0 | | [crustbench-remimu](https://harnessreport.com/tasks/crustbench/crustbench-remimu.md) | easy | | | 0 | | [crustbench-rhbloom](https://harnessreport.com/tasks/crustbench/crustbench-rhbloom.md) | easy | | | 0 | | [crustbench-roaring-bitmap](https://harnessreport.com/tasks/crustbench/crustbench-roaring-bitmap.md) | easy | | | 0 | | [crustbench-rubiksolver](https://harnessreport.com/tasks/crustbench/crustbench-rubiksolver.md) | medium | | | 0 | | [crustbench-satc](https://harnessreport.com/tasks/crustbench/crustbench-satc.md) | easy | | | 0 | | [crustbench-simple-config](https://harnessreport.com/tasks/crustbench/crustbench-simple-config.md) | easy | | | 0 | | [crustbench-simple-lang](https://harnessreport.com/tasks/crustbench/crustbench-simple-lang.md) | easy | | | 0 | | [crustbench-simple-sparsehash](https://harnessreport.com/tasks/crustbench/crustbench-simple-sparsehash.md) | easy | | | 0 | | [crustbench-simplexml](https://harnessreport.com/tasks/crustbench/crustbench-simplexml.md) | medium | | | 0 | | [crustbench-skp](https://harnessreport.com/tasks/crustbench/crustbench-skp.md) | easy | | | 0 | | [crustbench-slothlang](https://harnessreport.com/tasks/crustbench/crustbench-slothlang.md) | medium | | | 0 | | [crustbench-ted](https://harnessreport.com/tasks/crustbench/crustbench-ted.md) | easy | | | 0 | | [crustbench-tisp](https://harnessreport.com/tasks/crustbench/crustbench-tisp.md) | medium | | | 0 | | [crustbench-totp](https://harnessreport.com/tasks/crustbench/crustbench-totp.md) | medium | | | 0 | | [crustbench-ulidgen](https://harnessreport.com/tasks/crustbench/crustbench-ulidgen.md) | easy | | | 0 | | [crustbench-utf8](https://harnessreport.com/tasks/crustbench/crustbench-utf8.md) | easy | | | 0 | | [crustbench-vaultsync](https://harnessreport.com/tasks/crustbench/crustbench-vaultsync.md) | hard | | | 0 | | [crustbench-vec](https://harnessreport.com/tasks/crustbench/crustbench-vec.md) | easy | | | 0 | | [crustbench-worsp](https://harnessreport.com/tasks/crustbench/crustbench-worsp.md) | easy | | | 0 | | [crustbench-xopt](https://harnessreport.com/tasks/crustbench/crustbench-xopt.md) | easy | | | 0 | --- Harness Report runs agent harnesses from their GitHub repos on Harbor tasks and records every model call. Every page is also `.md` and `.json`; index: https://harnessreport.com/llms.txt · MCP: https://harnessreport.com/mcp