← Back OpenAI: GPT-5.6 Sol
TypeScript · With Guidelines · 2026-09-2898.9%Task Pass Rate
188/190Checks Passed
83Total Evals
Pass Rate Over Time
Click a data point to view results from that date.
| Pass | Task | Checks | Run Time | |
|---|
| ✓ | Auth Identity Check | 1/1 | 10.5s | |
| ✓ | Private Vs Public Table | 1/1 | 14.8s | |
| ✓ | Registered User Gate | 1/1 | 13s | |
| ✓ | Admin Bootstrap | 1/1 | 13s | |
| ✓ | Role Based Access | 1/1 | 14.1s | |
| ✓ | Ban List | 1/1 | 14.1s | |
| ✓ | Rate Limit | 1/1 | 12.4s | |
| ✓ | Shared Document | 1/1 | 14.1s | |
| ✓ | Secure Projection | 2/2 | 13s | |
| Pass | Task | Checks | Run Time | |
|---|
| ✓ | Empty Reducers | 1/1 | 8.3s | |
| ✓ | Basic Tables | 1/1 | 15.8s | |
| ✓ | Scheduled Table | 1/1 | 19.1s | |
| ✓ | Struct In Table | 1/1 | 12.6s | |
| ✓ | Insert | 2/2 | 12.6s | |
| ✓ | Update | 3/3 | 13.4s | |
| ✓ | Delete | 3/3 | 9.8s | |
| ✓ | Crud | 4/4 | 17s | |
| ✓ | Index Lookup | 3/3 | 13.4s | |
| ✓ | Init | 4/4 | 12.6s | |
| ✓ | Connect | 1/1 | 11.6s | |
| ✓ | Helper Function | 3/3 | 12.6s | |
| ✓ | Schedule At Time | 1/1 | 17s | |
| ✓ | Cancel Schedule | 1/1 | 15.5s | |
| ✓ | Lifecycle Player | 1/1 | 10.5s | |
| Pass | Task | Checks | Run Time | |
|---|
| ✓ | Event Table | 1/1 | 9.5s | |
| ✓ | Optional Fields | 1/1 | 8.4s | |
| ✓ | Cascade Delete | 1/1 | 13.9s | |
| ✓ | Filter And Aggregate | 1/1 | 13.9s | |
| ✓ | Two Table Join | 1/1 | 10.6s | |
| ✓ | Unique Constraint | 1/1 | 6.8s | |
| Pass | Task | Checks | Run Time | |
|---|
| ✓ | Scheduled Materialization | 4/4 | 15.5s | |
| ✓ | Connection Scoped Presence | 4/4 | 13.9s | |
| ✓ | Scheduled Private | 3/3 | 15.4s | |
| Pass | Task | Checks | Run Time | |
|---|
| ✓ | Automatic Migration | 3/3 | 13.1s | |
| ✓ | Incremental Migration | 4/4 | 14.9s | |
| ✓ | Hot Swap Compatibility | 2/2 | 11.6s | |
| Pass | Task | Checks | Run Time | |
|---|
| ✓ | Procedure Return | 2/2 | 14.8s | |
| ✓ | Http Fetch | 2/2 | 13.5s | |
| ✓ | Fetch And Store | 3/3 | 15s | |
| ✓ | Scheduled Procedure | 3/3 | 14.8s | |
| ✓ | Http Handler | 2/2 | 6.8s | |
| ✓ | Http Router | 2/2 | 10.7s | |
| ✓ | Idempotent Webhook | 3/3 | 26.4s | |
| ✓ | External Upload Flow | 4/4 | 20.4s | |
| Pass | Task | Checks | Run Time | |
|---|
| ✗ | View Basic | 0/1 | 12s | |
| ✓ | View Per User | 1/1 | 20.2s | |
| ✓ | Range Query | 1/1 | 20.2s | |
| ✓ | Sort And Limit | 1/1 | 20.3s | |
| ✓ | Find First | 1/1 | 20.2s | |
| ✓ | Select Distinct | 1/1 | 15.9s | |
| ✓ | Count Without Collect | 1/1 | 16.8s | |
| ✓ | Multi Column Filter | 1/1 | 15.9s | |
| Pass | Task | Checks | Run Time | |
|---|
| ✓ | Atomic Idempotent Transfer | 5/5 | 18.5s | |
| ✓ | Nested Update | 3/3 | 17.7s | |
| ✓ | Nested Cascade Delete | 11/11 | 18.5s | |
| ✓ | Batched Delete | 4/4 | 22.2s | |
| ✓ | Deterministic Context | 5/5 | 14.7s | |
| ✓ | Reducer Result Table | 2/2 | 7.7s | |
| Pass | Task | Checks | Run Time | |
|---|
| ✓ | Spacetime Product Type | 3/3 | 12s | |
| ✓ | Spacetime Sum Type | 3/3 | 13.9s | |
| ✓ | Elementary Columns | 3/3 | 11.9s | |
| ✓ | Product Type Columns | 3/3 | 13.3s | |
| ✓ | Sum Type Columns | 3/3 | 14.2s | |
| ✓ | Scheduled Columns | 2/2 | 19.2s | |
| ✓ | Constraints | 3/3 | 12s | |
| ✓ | Many To Many | 5/5 | 19.2s | |
| ✓ | Ecs | 7/7 | 19.2s | |
| ✓ | Multi Column Index | 5/5 | 14.2s | |
| Pass | Task | Checks | Run Time | |
|---|
| ✓ | Normalized Collection | 1/1 | 14.2s | |
| ✓ | Heartbeat Isolation | 1/1 | 8.6s | |
| ✓ | Binary Storage | 2/2 | 8s | |
| ✓ | Normalized Schema | 1/1 | 7.9s | |
| ✓ | Denormalized Index | 4/4 | 26.2s | |
| ✓ | Autoinc Reference | 2/2 | 14.2s | |
| ✓ | Default Values | 2/2 | 9.3s | |
| ✓ | Special Types | 1/1 | 15.1s | |
| Pass | Task | Checks | Run Time | |
|---|
| ✗ | Three Table Join | 1/2 | 28.2s | |
| ✓ | Semijoin Intersection | 2/2 | 15.6s | |
| ✓ | Timestamp Window | 2/2 | 15.6s | |
| ✓ | Index And Filter | 2/2 | 15.9s | |
|