← Back to benchmark
Raw run data
Every individual run — read only. Click a row to inspect its scores, checker verdict, efficiency, and final report.
126 of 126 runs
Per-metric comparison
Success
codex
97%
claude
95%
cursor
81%
Evidence rigor
codex
100%
claude
85%
cursor
83%
Adherence
claude
100%
codex
100%
cursor
93%
Tokens
cursor
763,708
codex
1,198,552
claude
1,221,837
Agent time
codex
140s
cursor
147s
claude
279s
Commands
codex
39.4
claude
54.3
cursor
79.8
| Run | Task | Agent | Arm | Success | Adher. | Rigor | Tokens | Cost | Agent time | Cmds |
|---|---|---|---|---|---|---|---|---|---|---|
2026-10-19T14:51:59.588Z | s4-persistence-hunt | claude | no-skill | 1 | 1 | 0.5 | 1,247,383 | $2.716 | 378.4s | 43 |
2026-10-19T15:04:36.924Z | s4-persistence-hunt | cursor | skill | 0.71 | 1 | 0 | 530,356 | ~$0.512 | 74.5s | 62 |
2026-10-19T15:07:54.169Z | s4-persistence-hunt | claude | skill | 1 | 1 | 0.5 | 1,321,701 | $1.117 | 226.2s | 41 (2) |
2026-10-19T15:13:46.813Z | s4-persistence-hunt | cursor | no-skill | 0.79 | 1 | 1 | 190,237 | ~$0.318 | 63.6s | 47 |
2026-10-19T15:44:55.222Z | s4-persistence-hunt | codex | skill | 1 | 1 | 1 | 1,002,665 | — | 130.1s | 41 (1) |
2026-10-19T15:49:09.648Z | s4-persistence-hunt | codex | no-skill | 1 | 1 | 1 | 445,896 | — | 90.6s | 15 |
2026-10-19T16:13:02.544Z | s6-pipeline-oidc | claude | skill | 1 | 1 | 1 | 1,049,472 | $0.947 | 302.6s | 38 (3) |
2026-10-19T16:20:08.745Z | s6-pipeline-oidc | cursor | skill | 1 | 1 | 1 | 775,673 | ~$0.679 | 93.2s | 74 (2) |
2026-10-19T16:23:45.890Z | s6-pipeline-oidc | claude | no-skill | 0.95 | 1 | 0.5 | 675,397 | $1.413 | 242.2s | 38 (3) |
2026-10-19T16:30:51.782Z | s6-pipeline-oidc | codex | no-skill | 1 | 1 | 1 | 767,982 | — | 116.4s | 48 (1) |
2026-10-19T16:38:11.743Z | s6-pipeline-oidc | codex | skill | 1 | 1 | 1 | 1,519,145 | — | 178.6s | 53 (1) |
2026-10-19T17:08:16.812Z | s6-pipeline-oidc | claude | no-skill | 1 | 1 | 1 | 424,452 | $0.536 | 150.1s | 28 |
2026-10-19T18:12:33.978Z | s4-persistence-hunt | codex | no-skill | 1 | 1 | 1 | 344,711 | — | 84.7s | 24 (1) |
2026-10-19T18:16:04.971Z | s4-persistence-hunt | codex | no-skill | 1 | 1 | 1 | 261,799 | — | 72s | 22 |
2026-10-19T20:08:44.688Z | s1-ci-key-escalation | cursor | skill | 0.86 | 1 | 1 | 855,153 | ~$0.725 | 81.6s | 104 (5) |
2026-10-19T20:12:10.497Z | s1-ci-key-escalation | cursor | no-skill | 0.9 | 1 | 1 | 372,145 | ~$0.467 | 78.3s | 57 (2) |
2026-10-19T20:15:34.694Z | s1-ci-key-escalation | codex | skill | 1 | 1 | 1 | 1,435,845 | — | 125.7s | 51 (2) |
2026-10-19T20:19:46.365Z | s1-ci-key-escalation | claude | skill | 1 | 1 | 1 | 1,012,155 | $0.859 | 167.8s | 60 (3) |
2026-10-19T20:24:39.990Z | s1-ci-key-escalation | claude | no-skill | 1 | 1 | 1 | 574,886 | $0.603 | 154s | 25 (2) |
2026-10-19T20:29:20.704Z | s1-ci-key-escalation | codex | no-skill | 0.9 | 1 | 1 | 478,212 | — | 90.8s | 18 |
2026-10-19T20:32:53.341Z | s1-ci-key-escalation | cursor | skill | 0.95 | 1 | 1 | 1,525,991 | ~$1.126 | 331.7s | 63 (3) |
2026-10-19T20:40:28.858Z | s1-ci-key-escalation | claude | skill | 0.95 | 1 | 1 | 1,215,632 | $1.001 | 215s | 50 (1) |
2026-10-19T22:08:26.330Z | s1-ci-key-escalation | claude | skill | 1 | 1 | 1 | 1,387,559 | $1.132 | 177.7s | 80 (2) |
2026-10-19T22:13:27.831Z | s1-ci-key-escalation | cursor | skill | 1 | 1 | 1 | 577,455 | ~$0.568 | 142s | 55 (5) |
2026-10-19T22:16:36.808Z | s1-ci-key-escalation | codex | skill | 0.95 | 1 | 1 | 1,699,278 | — | 134.1s | 50 (1) |
2026-10-19T22:20:54.828Z | s1-ci-key-escalation | codex | skill | 1 | 1 | 1 | 1,002,195 | — | 113.3s | 44 (1) |
2026-10-19T22:22:57.681Z | s1-ci-key-escalation | codex | no-skill | 0.9 | 1 | 1 | 764,718 | — | 112.2s | 35 (2) |
2026-10-19T22:26:54.723Z | s1-ci-key-escalation | claude | no-skill | 1 | 1 | 0.5 | 681,468 | $0.705 | 122.2s | 56 |
2026-10-19T22:31:00.754Z | s1-ci-key-escalation | cursor | no-skill | 0.95 | 1 | 1 | 435,877 | ~$0.521 | 112.9s | 64 (4) |
2026-10-19T22:34:59.949Z | s1-ci-key-escalation | codex | no-skill | 1 | 1 | 1 | 489,636 | — | 89.8s | 21 |
2026-10-19T22:38:36.653Z | s1-ci-key-escalation | claude | no-skill | 1 | 1 | 1 | 563,146 | $0.614 | 129.2s | 24 |
2026-10-19T22:42:53.849Z | s1-ci-key-escalation | cursor | no-skill | 0.8 | 1 | 0.5 | 375,558 | ~$0.402 | 96.8s | 72 (7) |
2026-10-19T23:02:46.301Z | s3-ransomware-blindspot | cursor | no-skill | 0.75 | 1 | 0.5 | 745,348 | ~$0.682 | 89.7s | 82 (2) |
2026-10-19T23:06:18.512Z | s3-ransomware-blindspot | codex | no-skill | 0.86 | 1 | 1 | 220,968 | — | 68.1s | 17 (1) |
2026-10-19T23:12:59.292Z | s3-ransomware-blindspot | claude | skill | 0.73 | 1 | 0 | 1,445,908 | $1.328 | 183.2s | 45 (1) |
2026-10-19T23:18:04.547Z | s3-ransomware-blindspot | codex | skill | 1 | 1 | 1 | 869,413 | — | 104.4s | 25 (1) |
2026-10-19T23:21:50.993Z | s3-ransomware-blindspot | cursor | skill | 1 | 1 | 1 | 1,054,787 | ~$0.828 | 85s | 115 (9) |
2026-10-19T23:25:18.236Z | s3-ransomware-blindspot | cursor | skill | 1 | 1 | 1 | 614,534 | ~$0.559 | 96.3s | 62 (1) |
2026-10-19T23:28:56.877Z | s3-ransomware-blindspot | codex | no-skill | 0.92 | 1 | 1 | 355,011 | — | 70.9s | 16 (1) |
2026-10-19T23:32:09.930Z | s3-ransomware-blindspot | codex | skill | 1 | 1 | 1 | 972,684 | — | 94.4s | 23 (1) |
2026-10-19T23:35:46.702Z | s3-ransomware-blindspot | claude | skill | 1 | 1 | 1 | 1,608,593 | $1.254 | 162.5s | 51 |
2026-10-20T00:33:14.065Z | s3-ransomware-blindspot | claude | skill | 1 | 1 | 1 | 1,251,932 | $1.104 | 187.7s | 65 (2) |
2026-10-20T00:38:23.900Z | s3-ransomware-blindspot | codex | skill | 1 | 1 | 1 | 1,069,991 | — | 111.2s | 29 (1) |
2026-10-20T00:42:17.424Z | s3-ransomware-blindspot | codex | no-skill | 0.86 | 1 | 1 | 330,906 | — | 67.9s | 10 |
2026-10-20T00:45:27.656Z | s3-ransomware-blindspot | cursor | skill | 1 | 1 | 1 | 624,510 | ~$0.582 | 145.4s | 103 (2) |
2026-10-20T01:07:45.689Z | s5-snapshot-exfil | cursor | skill | 0.76 | 1 | 1 | 1,353,153 | ~$1.055 | 647.4s | 66 (3) |
2026-10-20T01:20:34.792Z | s5-snapshot-exfil | claude | skill | 1 | 1 | 1 | 1,315,098 | $1.167 | 223.8s | 56 (1) |
2026-10-20T01:26:20.039Z | s5-snapshot-exfil | codex | no-skill | 0.9 | 1 | 1 | 347,493 | — | 78.8s | 30 |
2026-10-20T01:29:40.351Z | s5-snapshot-exfil | cursor | no-skill | 0.55 | 1 | 1 | 1,070,147 | ~$0.938 | 120.8s | 73 (3) |
2026-10-20T01:33:42.495Z | s5-snapshot-exfil | claude | no-skill | 0.43 | 1 | 1 | 493,301 | $0.631 | 142.8s | 37 (2) |
2026-10-20T01:38:06.585Z | s5-snapshot-exfil | codex | skill | 1 | 1 | 1 | 1,329,329 | — | 141.1s | 43 (2) |
2026-10-20T01:42:28.934Z | s5-snapshot-exfil | codex | skill | 1 | 1 | 1 | 1,422,059 | — | 157.5s | 46 (3) |
2026-10-20T01:47:07.702Z | s5-snapshot-exfil | codex | no-skill | 1 | 1 | 1 | 497,954 | — | 90.8s | 37 |
2026-10-20T01:50:39.786Z | s5-snapshot-exfil | claude | no-skill | 1 | 1 | 0.5 | 1,137,406 | $2.766 | 319s | 58 (2) |
2026-10-20T02:15:48.775Z | s5-snapshot-exfil | cursor | skill | 0.55 | 1 | 1 | 1,096,173 | ~$0.901 | 220.5s | 48 (4) |
2026-10-20T02:34:52.734Z | s5-snapshot-exfil | cursor | no-skill | 0.18 | 1 | 0.5 | 883,612 | ~$0.836 | 114.1s | 92 (5) |
2026-10-20T02:38:48.310Z | s5-snapshot-exfil | claude | skill | 1 | 1 | 0.5 | 1,243,003 | $1.098 | 327.1s | 56 (2) |
2026-10-20T02:46:16.748Z | s5-snapshot-exfil | codex | no-skill | 0.95 | 1 | 1 | 443,747 | — | 83.3s | 45 (1) |
2026-10-20T02:49:41.394Z | s5-snapshot-exfil | codex | skill | 1 | 1 | 1 | 4,070,833 | — | 206.7s | 55 (2) |
2026-10-20T03:01:30.632Z | s7-sagemaker-model-theft | codex | no-skill | 1 | 1 | 1 | 632,796 | — | 117.5s | 41 (1) |
2026-10-20T03:05:29.541Z | s7-sagemaker-model-theft | cursor | no-skill | 0.7 | 1 | 0.5 | 642,848 | ~$0.533 | 62.2s | 59 |
2026-10-20T03:08:35.625Z | s7-sagemaker-model-theft | claude | skill | 1 | 1 | 1 | 1,678,851 | $1.371 | 190.5s | 75 (2) |
2026-10-20T03:13:49.427Z | s7-sagemaker-model-theft | claude | no-skill | 1 | 1 | 1 | 978,317 | $0.865 | 153.5s | 57 (1) |
2026-10-20T03:18:26.247Z | s7-sagemaker-model-theft | codex | skill | 0.95 | 1 | 1 | 1,419,137 | — | 183.6s | 60 (1) |
2026-10-20T03:23:33.235Z | s7-sagemaker-model-theft | cursor | skill | 0.7 | 1 | 0.5 | 918,397 | ~$0.866 | 89s | 131 (2) |
2026-10-20T03:27:05.573Z | s7-sagemaker-model-theft | codex | skill | 1 | 1 | 1 | 1,767,074 | — | 225.2s | 49 (3) |
2026-10-20T03:32:54.082Z | s7-sagemaker-model-theft | codex | no-skill | 1 | 1 | 1 | 732,423 | — | 123.8s | 37 |
2026-10-20T03:37:01.246Z | s7-sagemaker-model-theft | claude | skill | 0.9 | 1 | 1 | 1,965,978 | $1.334 | 238s | 81 (2) |
2026-10-20T03:43:02.509Z | s7-sagemaker-model-theft | cursor | skill | 0.73 | 1 | 1 | 790,457 | ~$0.697 | 115.4s | 90 (1) |
2026-10-20T03:47:01.289Z | s7-sagemaker-model-theft | claude | no-skill | 1 | 1 | 1 | 943,038 | $0.785 | 199.4s | 50 (4) |
2026-10-20T03:52:23.942Z | s7-sagemaker-model-theft | cursor | no-skill | 0.66 | 1 | 1 | 1,297,339 | ~$1.094 | 410.1s | 92 (3) |
2026-10-20T04:18:30.323Z | s7-sagemaker-model-theft | codex | skill | 1 | 1 | 1 | 1,340,035 | — | 138.5s | 45 (1) |
2026-10-20T04:22:52.286Z | s7-sagemaker-model-theft | cursor | no-skill | 0.61 | 1 | 1 | 897,389 | ~$0.800 | 99.9s | 108 (4) |
2026-10-20T04:26:35.900Z | s7-sagemaker-model-theft | cursor | skill | 0.77 | 1 | 1 | 1,283,623 | ~$0.963 | 106.7s | 147 (6) |
2026-10-20T04:30:26.024Z | s7-sagemaker-model-theft | claude | no-skill | 1 | 1 | 1 | 973,598 | $0.901 | 134.4s | 58 (1) |
2026-10-20T04:34:43.825Z | s7-sagemaker-model-theft | claude | skill | 0.9 | 1 | 1 | 3,455,244 | $1.984 | 330.9s | 118 |
2026-10-20T04:42:18.111Z | s7-sagemaker-model-theft | codex | no-skill | 1 | 1 | 1 | 673,515 | — | 115.3s | 42 (4) |
2026-10-20T13:17:29.989Z | s2-instance-cred-ssm | codex | no-skill | 1 | 1 | 1 | 564,907 | — | 157.6s | 41 (1) |
2026-10-20T13:22:09.342Z | s2-instance-cred-ssm | claude | no-skill | 0.95 | 1 | 1 | 579,302 | $0.662 | 369s | 47 (2) |
2026-10-20T13:39:15.100Z | s2-instance-cred-ssm | cursor | no-skill | 0.82 | 1 | 0.5 | 431,463 | ~$0.463 | 100.1s | 56 (1) |
2026-10-20T13:42:57.547Z | s2-instance-cred-ssm | cursor | skill | 0.89 | 0.5 | 1 | 903,938 | ~$0.774 | 101.8s | 84 (4) |
2026-10-20T13:46:41.027Z | s2-instance-cred-ssm | claude | skill | 0.93 | 1 | 1 | 2,611,507 | $3.179 | 577.3s | 99 (2) |
2026-10-20T16:09:40.070Z | s2-instance-cred-ssm | codex | no-skill | 0.85 | 1 | 1 | 683,377 | — | 109.8s | 41 (1) |
2026-10-20T16:13:31.615Z | s2-instance-cred-ssm | claude | no-skill | 1 | 1 | 1 | 1,104,588 | $0.867 | 404.3s | 71 (2) |
2026-10-20T16:22:17.782Z | s2-instance-cred-ssm | cursor | no-skill | 0.97 | 1 | 1 | 401,511 | ~$0.600 | 82.3s | 63 (4) |
2026-10-20T16:32:48.599Z | s2-instance-cred-ssm | claude | skill | 0.93 | 1 | 1 | 3,284,752 | $3.731 | 1,594.1s | 116 (2) |
2026-10-20T20:11:39.163Z | s2-instance-cred-ssm | claude | no-skill | 0.9 | 1 | 0.5 | 1,419,230 | $2.696 | 690s | 58 (1) |
2026-10-20T20:29:44.304Z | s2-instance-cred-ssm | claude | skill | 0.89 | 1 | 1 | 2,313,775 | $3.066 | 486.6s | 70 (2) |
2026-10-20T20:39:52.598Z | s2-instance-cred-ssm | cursor | skill | 0.8 | 0.5 | 0.5 | 1,052,641 | ~$0.881 | 199.1s | 65 (3) |
2026-10-20T20:46:13.822Z | s2-instance-cred-ssm | cursor | no-skill | 0.86 | 0.5 | 0.5 | 501,725 | ~$0.491 | 68.8s | 59 (2) |
2026-10-20T20:49:24.395Z | s2-instance-cred-ssm | codex | skill | 1 | 1 | 1 | 1,836,907 | — | 257s | 60 (4) |
2026-10-20T20:53:43.500Z | s2-instance-cred-ssm | cursor | skill | 0.85 | 0.5 | 0.5 | 817,875 | ~$0.688 | 104.1s | 66 (5) |
2026-10-20T21:57:51.012Z | s4-persistence-hunt | claude | no-skill | 1 | 1 | 0.5 | 484,815 | $0.549 | 196.5s | 21 (2) |
2026-10-20T22:03:11.747Z | s4-persistence-hunt | claude | skill | 1 | 1 | 1 | 1,073,460 | $1.070 | 246.1s | 40 (2) |
2026-10-20T22:09:24.214Z | s4-persistence-hunt | cursor | skill | 0.78 | 1 | 1 | 690,230 | ~$0.644 | 124.5s | 87 (2) |
2026-10-20T22:13:35.640Z | s4-persistence-hunt | cursor | no-skill | 0.83 | 0.5 | 1 | 224,474 | ~$0.289 | 66.4s | 48 (1) |
2026-10-20T22:16:48.361Z | s4-persistence-hunt | cursor | skill | 0.96 | 0.5 | 0.5 | 778,008 | ~$0.681 | 105.3s | 97 (1) |
2026-10-20T22:20:37.889Z | s4-persistence-hunt | claude | no-skill | 1 | 1 | 1 | 493,864 | $0.520 | 136.5s | 17 (2) |
2026-10-20T22:25:00.776Z | s4-persistence-hunt | claude | skill | 1 | 1 | 1 | 899,398 | $0.889 | 175.7s | 51 |
2026-10-20T22:30:02.791Z | s4-persistence-hunt | cursor | no-skill | 1 | 1 | 1 | 453,536 | ~$0.469 | 67.9s | 60 (3) |
2026-10-21T00:05:15.163Z | s6-pipeline-oidc | cursor | skill | 0.89 | 1 | 0.5 | 924,553 | ~$0.762 | 81.5s | 67 (1) |
2026-10-21T00:08:38.398Z | s6-pipeline-oidc | claude | skill | 1 | 1 | 0.5 | 1,285,371 | $1.069 | 252.9s | 58 (4) |
2026-10-21T00:14:54.773Z | s6-pipeline-oidc | codex | no-skill | 1 | 1 | 1 | 564,179 | — | 109.7s | 43 (1) |
2026-10-21T00:18:48.092Z | s6-pipeline-oidc | claude | no-skill | 0.79 | 1 | 0.5 | 597,438 | $1.349 | 179.3s | 25 |
2026-10-21T00:24:49.183Z | s6-pipeline-oidc | codex | skill | 1 | 1 | 1 | 2,200,150 | — | 226s | 60 (3) |
2026-10-21T00:30:38.629Z | s6-pipeline-oidc | cursor | no-skill | 0.79 | 1 | 1 | 694,473 | ~$0.619 | 87.3s | 93 (11) |
2026-10-21T00:32:11.811Z | s6-pipeline-oidc | cursor | skill | 1 | 1 | 1 | 744,145 | ~$0.723 | 79.3s | 110 (2) |
2026-10-21T00:35:34.765Z | s6-pipeline-oidc | codex | skill | 1 | 1 | 1 | 1,411,337 | — | 149.9s | 49 (1) |
2026-10-21T00:40:08.325Z | s6-pipeline-oidc | claude | skill | 1 | 1 | 1 | 1,533,356 | $1.245 | 280.3s | 66 (1) |
2026-10-21T00:44:53.689Z | s6-pipeline-oidc | cursor | no-skill | 0.89 | 1 | 1 | 407,332 | ~$0.457 | 63.9s | 94 (3) |
2026-10-21T00:47:59.407Z | s6-pipeline-oidc | codex | no-skill | 0.95 | 1 | 1 | 470,266 | — | 122.4s | 19 |
2026-10-21T01:48:19.184Z | s3-ransomware-blindspot | claude | no-skill | 0.9 | 1 | 0.5 | 451,400 | $0.525 | 97.9s | 35 (2) |
2026-10-21T01:51:59.366Z | s3-ransomware-blindspot | claude | no-skill | 0.86 | 1 | 1 | 444,136 | $0.516 | 119.1s | 37 (2) |
2026-10-21T01:56:00.826Z | s3-ransomware-blindspot | claude | no-skill | 1 | 1 | 1 | 378,311 | $0.619 | 92.2s | 30 |
2026-10-21T02:00:17.024Z | s4-persistence-hunt | codex | skill | 1 | 1 | 1 | 1,279,987 | — | 178.5s | 45 (3) |
2026-10-21T02:05:17.839Z | s4-persistence-hunt | codex | skill | 1 | 1 | 1 | 2,045,632 | — | 215.5s | 44 (4) |
2026-10-21T18:38:50.609Z | s6-pipeline-oidc | cursor | no-skill | 0.89 | 1 | 1 | 514,666 | ~$0.567 | 105.4s | 93 (7) |
2026-10-21T18:41:22.023Z | s3-ransomware-blindspot | cursor | no-skill | 0.65 | 1 | 1 | 1,059,748 | ~$0.883 | 301.4s | 84 (3) |
2026-10-21T18:48:25.721Z | s3-ransomware-blindspot | cursor | no-skill | 0.67 | 1 | 1 | 534,413 | ~$0.651 | 119.5s | 83 (3) |
2026-10-21T18:54:02.146Z | s2-instance-cred-ssm | codex | skill | 1 | 1 | 1 | 3,922,726 | — | 267s | 67 (4) |
2026-10-21T19:01:31.008Z | s2-instance-cred-ssm | codex | skill | 0.95 | 1 | 1 | 6,117,439 | — | 436.1s | 82 (6) |
2026-10-21T20:34:16.953Z | s2-instance-cred-ssm | codex | no-skill | 0.95 | 1 | 1 | 534,839 | — | 123.2s | 32 (1) |
2026-10-21T20:59:12.126Z | s5-snapshot-exfil | claude | no-skill | 1 | 1 | 1 | 943,929 | $0.750 | 341.5s | 44 (4) |
2026-10-21T21:06:55.176Z | s5-snapshot-exfil | claude | skill | 1 | 1 | 1 | 2,774,987 | $4.395 | 435.5s | 107 (1) |
2026-10-21T21:16:11.852Z | s5-snapshot-exfil | cursor | skill | 0.95 | 1 | 1 | 1,304,163 | ~$1.031 | 672s | 95 (4) |
2026-10-21T22:03:40.046Z | s5-snapshot-exfil | cursor | no-skill | 0.4 | 1 | 0.5 | 726,083 | ~$0.692 | 149.3s | 80 (5) |