expected outcome OUTCOME_OK, got OUTCOME_NONE_CLARIFICATION
trial=vm-03nk8cjggjyhevaoem | ts=2026-04-10T22:58:06.268400+00:00
BitGN Native Analytics
Run Matrix Dashboard
Rows are tasks. Columns are runs (newest to oldest). Missing task in run is S (skip).
Mode
All runs
Columns
Last 40
Runs shown
40
Pass rate
98.6%
P pass (356) F fail (5) E error (0) N no feedback (0) S skip (1359)
Generated: 2026-04-11T08:31:10.330078+00:00
| Task | Coverage | R01 20260411T001001Z_3732508 | R02 20260410T233738Z_3625495 | R03 20260410T233603Z_3620843 | R04 20260410T233434Z_3616368 | R05 20260410T233227Z_3610307 | R06 20260410T233054Z_3605663 | R07 20260410T232903Z_3600301 | R08 20260410T232701Z_3594474 | R09 20260410T232537Z_3590218 | R10 20260410T232417Z_3586106 | R11 20260410T232229Z_3580619 | R12 20260410T232045Z_3575449 | R13 20260410T231909Z_3570658 | R14 20260410T230440Z_3510014 | R15 20260410T225336Z_3459490 | R16 20260410T223953Z_3401228 | R17 20260410T223759Z_3395052 | R18 20260410T223614Z_3389089 | R19 20260410T223400Z_3381765 | R20 20260410T223129Z_3373497 | R21 20260410T222957Z_3368109 | R22 20260410T222739Z_3360708 | R23 20260410T221034Z_3292315 | R24 20260410T220052Z_3244768 | R25 20260410T214741Z_3198711 | R26 20260410T213810Z_3162924 | R27 20260410T213300Z_3147752 | R28 20260410T213129Z_3142064 | R29 20260410T212938Z_3135519 | R30 20260410T212808Z_3129784 | R31 20260410T212627Z_3123846 | R32 20260410T212510Z_3120063 | R33 20260410T212343Z_3115787 | R34 20260410T212236Z_3112461 | R35 20260410T212104Z_3108000 | R36 20260410T211919Z_3102883 | R37 20260410T211739Z_3098028 | R38 20260410T211553Z_3092935 | R39 20260410T211316Z_3085207 | R40 20260410T211122Z_3079848 |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| t01 | 7/40 100% | P
vm
| P
vm
| S | S | S | S | S | S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | P
vm
| P
vm
| S | S | S | S | S | S | S | S | S | S | S | S | S | S | S | S |
| t02 | 6/40 100% | S | P
vm
| S | S | S | S | S | S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | P
vm
| P
vm
| S | S | S | S | S | S | S | S | S | S | S | S | S | S | S | S |
| t03 | 8/40 100% | S | P
vm
| S | S | S | S | S | S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | S | S | S | S | S | S | S | S |
| t04 | 6/40 100% | S | P
vm
| S | S | S | S | S | S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | P
vm
| P
vm
| S | S | S | S | S | S | S | S | S | S | S | S | S | S | S | S |
| t05 | 6/40 100% | S | P
vm
| S | S | S | S | S | S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | P
vm
| P
vm
| S | S | S | S | S | S | S | S | S | S | S | S | S | S | S | S |
| t06 | 6/40 100% | S | P
vm
| S | S | S | S | S | S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | P
vm
| P
vm
| S | S | S | S | S | S | S | S | S | S | S | S | S | S | S | S |
| t07 | 8/40 100% | S | P
vm
| S | S | S | S | S | S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | S | S | S | S | S | S | S | S |
| t08 | 14/40 93% | S | P
vm
| S | S | S | S | S | S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| P
vm
| P
vm
| P
vm
| P
vm
| P
vm
| P
vm
| P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | S | S | S | S | S | S | S | S | |
| t09 | 8/40 100% | S | P
vm
| S | S | S | S | S | S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | S | S | S | S | S | S | S | S |
| t10 | 6/40 100% | S | P
vm
| S | S | S | S | S | S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | P
vm
| P
vm
| S | S | S | S | S | S | S | S | S | S | S | S | S | S | S | S |
| t11 | 6/40 100% | S | P
vm
| S | S | S | S | S | S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | P
vm
| P
vm
| S | S | S | S | S | S | S | S | S | S | S | S | S | S | S | S |
| t12 | 6/40 100% | S | P
vm
| S | S | S | S | S | S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | P
vm
| P
vm
| S | S | S | S | S | S | S | S | S | S | S | S | S | S | S | S |
| t13 | 6/40 100% | S | P
vm
| S | S | S | S | S | S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | P
vm
| P
vm
| S | S | S | S | S | S | S | S | S | S | S | S | S | S | S | S |
| t14 | 6/40 100% | S | P
vm
| S | S | S | S | S | S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | P
vm
| P
vm
| S | S | S | S | S | S | S | S | S | S | S | S | S | S | S | S |
| t15 | 6/40 100% | S | P
vm
| S | S | S | S | S | S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | P
vm
| P
vm
| S | S | S | S | S | S | S | S | S | S | S | S | S | S | S | S |
| t16 | 8/40 100% | S | P
vm
| S | S | S | S | S | S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | S | S | S | S | S | S | S | S |
| t17 | 6/40 100% | S | P
vm
| S | S | S | S | S | S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | P
vm
| P
vm
| S | S | S | S | S | S | S | S | S | S | S | S | S | S | S | S |
| t18 | 8/40 100% | S | P
vm
| S | S | S | S | S | S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | S | S | S | S | S | S | S | S |
| t19 | 20/40 90% | S | P
vm
| S | S | S | S | S | P
vm
| P
vm
| P
vm
| P
vm
| P
vm
| P
vm
| P
vm
| P
vm
| P
vm
| P
vm
| P
vm
| P
vm
| P
vm
| P
vm
| P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | S | S | S | S | S | S | S | S | ||
| t20 | 17/40 100% | S | P
vm
| S | S | S | S | S | S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| P
vm
| P
vm
| P
vm
| P
vm
| P
vm
| P
vm
| S | S | S | S | S | P
vm
| P
vm
| P
vm
| P
vm
|
| t21 | 8/40 100% | S | P
vm
| S | S | S | S | S | S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | S | S | S | S | S | S | S | S |
| t22 | 13/40 100% | S | P
vm
| S | S | S | S | S | S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| P
vm
| P
vm
| P
vm
| P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | S | S | S |
| t23 | 13/40 92% | S | P
vm
| P
vm
| P
vm
| P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | P
vm
| P
vm
| S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | S | S | S | S | S | S | S | S | |
| t24 | 8/40 100% | S | P
vm
| S | S | S | S | S | S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | S | S | S | S | S | S | S | S |
| t25 | 8/40 100% | S | P
vm
| S | S | S | S | S | S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | S | S | S | S | S | S | S | S |
| t26 | 6/40 100% | S | P
vm
| S | S | S | S | S | S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | P
vm
| P
vm
| S | S | S | S | S | S | S | S | S | S | S | S | S | S | S | S |
| t27 | 8/40 100% | S | P
vm
| S | S | S | S | S | S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | S | S | S | S | S | S | S | S |
| t28 | 8/40 100% | S | P
vm
| S | S | S | S | S | S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | S | S | S | S | S | S | S | S |
| t29 | 8/40 100% | S | P
vm
| S | S | S | S | S | S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | S | S | S | S | S | S | S | S |
| t30 | 6/40 100% | S | P
vm
| S | S | S | S | S | S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | P
vm
| P
vm
| S | S | S | S | S | S | S | S | S | S | S | S | S | S | S | S |
| t31 | 6/40 100% | S | P
vm
| S | S | S | S | S | S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | P
vm
| P
vm
| S | S | S | S | S | S | S | S | S | S | S | S | S | S | S | S |
| t32 | 6/40 100% | S | P
vm
| S | S | S | S | S | S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | P
vm
| P
vm
| S | S | S | S | S | S | S | S | S | S | S | S | S | S | S | S |
| t33 | 8/40 100% | S | P
vm
| S | S | S | S | S | S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | S | S | S | S | S | S | S | S |
| t34 | 12/40 92% | S | P
vm
| S | S | S | S | S | S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| P
vm
| P
vm
| P
vm
| P
vm
| P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | S | S | S | S | S | S | S | S | S | S | |
| t35 | 6/40 100% | S | P
vm
| S | S | S | S | S | S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | P
vm
| P
vm
| S | S | S | S | S | S | S | S | S | S | S | S | S | S | S | S |
| t36 | 8/40 100% | S | P
vm
| S | S | S | S | S | S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | S | S | S | S | S | S | S | S |
| t37 | 18/40 100% | S | P
vm
| S | S | S | S | S | S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| P
vm
| P
vm
| P
vm
| P
vm
| P
vm
| P
vm
| P
vm
| P
vm
| P
vm
| P
vm
| P
vm
| S | S | S | S |
| t38 | 6/40 100% | S | P
vm
| S | S | S | S | S | S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | P
vm
| P
vm
| S | S | S | S | S | S | S | S | S | S | S | S | S | S | S | S |
| t39 | 6/40 100% | S | P
vm
| S | S | S | S | S | S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | P
vm
| P
vm
| S | S | S | S | S | S | S | S | S | S | S | S | S | S | S | S |
| t40 | 6/40 100% | S | P
vm
| S | S | S | S | S | S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | P
vm
| P
vm
| S | S | S | S | S | S | S | S | S | S | S | S | S | S | S | S |
| t41 | 13/40 100% | S | P
vm
| S | S | S | S | S | S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| P
vm
| P
vm
| P
vm
| P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | S | S | S |
| t42 | 8/40 100% | S | P
vm
| S | S | S | S | S | S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | S | S | S | S | S | S | S | S |
| t43 | 8/40 100% | S | P
vm
| S | S | S | S | S | S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | P
vm
| P
vm
| P
vm
| P
vm
| S | S | S | S | S | S | S | S | S | S | S | S | S | S |
Failure Reasons
Click F/E/N in matrix cells to jump here.
expected outcome OUTCOME_OK, got OUTCOME_ERR_INTERNAL
trial=vm-03nk8cjgcd4t5vdbx2 | ts=2026-04-10T22:58:06.573487+00:00
expected outcome OUTCOME_NONE_CLARIFICATION, got OUTCOME_OK
trial=vm-03nk433ul3lxyqmzw3 | ts=2026-04-10T22:14:20.034847+00:00
JSON mismatch in 'outbox/84520.json': attachments[0]: expected "my-invoices/INV-001-05.json" got "my-invoices/INV-001-04.json"
trial=vm-03nk34kxa39k8yvmzh | ts=2026-04-10T22:06:06.971107+00:00
answer is incorrect. Expected: 'Acme Robotics GmbH'
trial=vm-03nk34kxto341rkiwl | ts=2026-04-10T22:09:59.691386+00:00