Evals: Nightly #261
gundermancevals-nightly.yml
on: workflow_dispatch
Matrix: Evals (USUALLY_PASSING) nightly run
Aggregate Results
1m 7s
Annotations
8 errors
|
Evals (USUALLY_PASSING) nightly run (gemini-3-flash-preview, 3)
Process completed with exit code 1.
|
|
Evals (USUALLY_PASSING) nightly run (gemini-2.5-flash, 1)
Process completed with exit code 1.
|
|
Evals (USUALLY_PASSING) nightly run (gemini-3-flash-preview, 1)
Process completed with exit code 1.
|
|
Evals (USUALLY_PASSING) nightly run (gemini-2.5-flash-lite, 3)
Process completed with exit code 1.
|
|
Evals (USUALLY_PASSING) nightly run (gemini-3-flash-preview, 2)
Process completed with exit code 1.
|
|
Evals (USUALLY_PASSING) nightly run (gemini-3.1-pro-preview-customtools, 2)
Process completed with exit code 1.
|
|
Evals (USUALLY_PASSING) nightly run (gemini-2.5-flash-lite, 2)
Process completed with exit code 1.
|
|
Evals (USUALLY_PASSING) nightly run (gemini-2.5-flash-lite, 1)
Process completed with exit code 1.
|
Artifacts
Produced during runtime
| Name | Size | Digest | |
|---|---|---|---|
|
eval-logs-gemini-2.5-flash-1
Expired
|
59.6 KB |
sha256:69b80e880e01b731e66dad44f5e66e71e3d8e01caee7b0f17588a3d83f628156
|
|
|
eval-logs-gemini-2.5-flash-2
Expired
|
5.46 KB |
sha256:eef43daeed17f5ec5b5833b2149e0506610147ed832a4e8ab15ec7775d6a56d9
|
|
|
eval-logs-gemini-2.5-flash-3
Expired
|
5.79 KB |
sha256:8722e87c39620871647838dbe34433d765a8feaf3d69a0b15ef9be346cc0e3a2
|
|
|
eval-logs-gemini-2.5-flash-lite-1
Expired
|
7.46 MB |
sha256:49608e838e8fff66d46aae801b17112bbb686e8857716e028b83347d29f054c2
|
|
|
eval-logs-gemini-2.5-flash-lite-2
Expired
|
1.99 MB |
sha256:986825c2fefecea8d299be8e56ecb2453924f1a06934a245846f041698b32f88
|
|
|
eval-logs-gemini-2.5-flash-lite-3
Expired
|
147 KB |
sha256:7c21e2a15054e693893c89d303d5f796bac0bb84ae74cbbe03d3b4ae3c61ac4a
|
|
|
eval-logs-gemini-2.5-pro-1
Expired
|
5.75 KB |
sha256:c72da2bcb3bffb9a3d6c83d443a4b9f202b5187271aa2685c1ad9e343991d7a6
|
|
|
eval-logs-gemini-2.5-pro-2
Expired
|
6.08 KB |
sha256:eaf48f37d530de46b61ee594c50370aa326f11d8efeddb2beb8a77b3b5321ca3
|
|
|
eval-logs-gemini-2.5-pro-3
Expired
|
5.57 KB |
sha256:d0c8bdcf94bb9a849017d0d4aa4a2d41ca667096fcc6f95a9b87608bab65658a
|
|
|
eval-logs-gemini-3-flash-preview-1
Expired
|
156 KB |
sha256:7f76bf107a517a4975c9ee803eca5fc99c9817b205e26a8fbd6c6b39baaa373e
|
|
|
eval-logs-gemini-3-flash-preview-2
Expired
|
37.5 KB |
sha256:c8bd06c9453922fa036c26006985df64b366b4bafe4d128dbd9ff33e06d83930
|
|
|
eval-logs-gemini-3-flash-preview-3
Expired
|
36.5 KB |
sha256:9f64444a7ced12ab2436f4a9e918a71d4bc3e694d5cb5983cd00b4dbd5ccc757
|
|
|
eval-logs-gemini-3-pro-preview-1
Expired
|
5.37 KB |
sha256:2524a5654e6f639283b23a99d26831464ad0e3c324fc0f7c55f43d31c496cfca
|
|
|
eval-logs-gemini-3-pro-preview-2
Expired
|
5.19 KB |
sha256:7623409dc2479ae01f75c753e98e556a10fba54a66eec0bf182ffae2d9916241
|
|
|
eval-logs-gemini-3-pro-preview-3
Expired
|
5.47 KB |
sha256:0468f0c9aa357cefe3ec8ede34ead1f16e53db5e452644be7943d6495d65f57b
|
|
|
eval-logs-gemini-3.1-pro-preview-customtools-1
Expired
|
5.25 KB |
sha256:bbf3b241b6e1d313fb861a783be6435856fe8b01bff386974c41457d47653137
|
|
|
eval-logs-gemini-3.1-pro-preview-customtools-2
Expired
|
55.9 KB |
sha256:04728f8dcccffcdd3ac2294384a5624c939a042ba6aef2567d2beac26794d492
|
|
|
eval-logs-gemini-3.1-pro-preview-customtools-3
Expired
|
5.34 KB |
sha256:15f946251e53c3eb79bc003a9144f117081746811ba44669941c607feb55e4a8
|
|