Compare top models

LLM Benchmarks

See how today's leading models write Spacetime code, scored task by task on live modules.

← Back

OpenAI: GPT-5.6 Sol

TypeScript · With Guidelines · 2026-09-28
98.9%Task Pass Rate
188/190Checks Passed
83Total Evals

Pass Rate Over Time

Click a data point to view results from that date.

auth

100% · 9 evals
PassTaskChecksRun Time
✓Auth Identity Check1/110.5s
✓Private Vs Public Table1/114.8s
✓Registered User Gate1/113s
✓Admin Bootstrap1/113s
✓Role Based Access1/114.1s
✓Ban List1/114.1s
✓Rate Limit1/112.4s
✓Shared Document1/114.1s
✓Secure Projection2/213s

basics

100% · 15 evals
PassTaskChecksRun Time
✓Empty Reducers1/18.3s
✓Basic Tables1/115.8s
✓Scheduled Table1/119.1s
✓Struct In Table1/112.6s
✓Insert2/212.6s
✓Update3/313.4s
✓Delete3/39.8s
✓Crud4/417s
✓Index Lookup3/313.4s
✓Init4/412.6s
✓Connect1/111.6s
✓Helper Function3/312.6s
✓Schedule At Time1/117s
✓Cancel Schedule1/115.5s
✓Lifecycle Player1/110.5s

data modeling

100% · 6 evals
PassTaskChecksRun Time
✓Event Table1/19.5s
✓Optional Fields1/18.4s
✓Cascade Delete1/113.9s
✓Filter And Aggregate1/113.9s
✓Two Table Join1/110.6s
✓Unique Constraint1/16.8s

lifecycle

100% · 3 evals
PassTaskChecksRun Time
✓Scheduled Materialization4/415.5s
✓Connection Scoped Presence4/413.9s
✓Scheduled Private3/315.4s

migrations

100% · 3 evals
PassTaskChecksRun Time
✓Automatic Migration3/313.1s
✓Incremental Migration4/414.9s
✓Hot Swap Compatibility2/211.6s

procedures

100% · 8 evals
PassTaskChecksRun Time
✓Procedure Return2/214.8s
✓Http Fetch2/213.5s
✓Fetch And Store3/315s
✓Scheduled Procedure3/314.8s
✓Http Handler2/26.8s
✓Http Router2/210.7s
✓Idempotent Webhook3/326.4s
✓External Upload Flow4/420.4s

queries

88% · 8 evals
PassTaskChecksRun Time
✗View Basic0/112s
✓View Per User1/120.2s
✓Range Query1/120.2s
✓Sort And Limit1/120.3s
✓Find First1/120.2s
✓Select Distinct1/115.9s
✓Count Without Collect1/116.8s
✓Multi Column Filter1/115.9s

reducers

100% · 6 evals
PassTaskChecksRun Time
✓Atomic Idempotent Transfer5/518.5s
✓Nested Update3/317.7s
✓Nested Cascade Delete11/1118.5s
✓Batched Delete4/422.2s
✓Deterministic Context5/514.7s
✓Reducer Result Table2/27.7s

schema

100% · 10 evals
PassTaskChecksRun Time
✓Spacetime Product Type3/312s
✓Spacetime Sum Type3/313.9s
✓Elementary Columns3/311.9s
✓Product Type Columns3/313.3s
✓Sum Type Columns3/314.2s
✓Scheduled Columns2/219.2s
✓Constraints3/312s
✓Many To Many5/519.2s
✓Ecs7/719.2s
✓Multi Column Index5/514.2s

tables

100% · 8 evals
PassTaskChecksRun Time
✓Normalized Collection1/114.2s
✓Heartbeat Isolation1/18.6s
✓Binary Storage2/28s
✓Normalized Schema1/17.9s
✓Denormalized Index4/426.2s
✓Autoinc Reference2/214.2s
✓Default Values2/29.3s
✓Special Types1/115.1s

views

93% · 7 evals
PassTaskChecksRun Time
✗Three Table Join1/228.2s
✓Semijoin Intersection2/215.6s
✓Timestamp Window2/215.6s
✓Index And Filter2/215.9s
✓Materialized Aggregate2/231.4s
✓Query Builder View2/29.2s
✓View Primary Key2/215.6s