Compare top models

LLM Benchmarks

See how today's leading models write Spacetime code, scored task by task on live modules.

← Back

OpenAI: GPT-6 Sol

Rust · With Guidelines · 2026-09-28
98.4%Task Pass Rate
187/190Checks Passed
83Total Evals

auth

100% · 9 evals
PassTaskChecksRun Time
✓Auth Identity Check1/126.3s
✓Private Vs Public Table1/123.3s
✓Registered User Gate1/135s
✓Admin Bootstrap1/129.1s
✓Role Based Access1/120.6s
✓Ban List1/123.5s
✓Rate Limit1/127.5s
✓Shared Document1/123.3s
✓Secure Projection2/234.2s

basics

100% · 15 evals
PassTaskChecksRun Time
✓Empty Reducers1/129.4s
✓Basic Tables1/131.1s
✓Scheduled Table1/135.3s
✓Struct In Table1/133.5s
✓Insert2/231.7s
✓Update3/329.1s
✓Delete3/335.9s
✓Crud4/435.8s
✓Index Lookup3/330.9s
✓Init4/433.5s
✓Connect1/130.5s
✓Helper Function3/332.8s
✓Schedule At Time1/132.2s
✓Cancel Schedule1/131.7s
✓Lifecycle Player1/130.8s

data modeling

100% · 6 evals
PassTaskChecksRun Time
✓Event Table1/133.8s
✓Optional Fields1/132.3s
✓Cascade Delete1/131.6s
✓Filter And Aggregate1/134.5s
✓Two Table Join1/132.8s
✓Unique Constraint1/134.7s

lifecycle

73% · 3 evals
PassTaskChecksRun Time
✓Scheduled Materialization4/436s
✓Connection Scoped Presence4/433.9s
✗Scheduled Private0/336.4s

migrations

100% · 3 evals
PassTaskChecksRun Time
✓Automatic Migration3/31m 0s
✓Incremental Migration4/41m 6s
✓Hot Swap Compatibility2/259.3s

procedures

100% · 8 evals
PassTaskChecksRun Time
✓Procedure Return2/223.9s
✓Http Fetch2/235.4s
✓Fetch And Store3/337.2s
✓Scheduled Procedure3/325.9s
✓Http Handler2/225.2s
✓Http Router2/235.8s
✓Idempotent Webhook3/342s
✓External Upload Flow4/428.6s

queries

100% · 8 evals
PassTaskChecksRun Time
✓View Basic1/133s
✓View Per User1/129.8s
✓Range Query1/132.8s
✓Sort And Limit1/136.2s
✓Find First1/129s
✓Select Distinct1/129.7s
✓Count Without Collect1/132.6s
✓Multi Column Filter1/129.3s

reducers

100% · 6 evals
PassTaskChecksRun Time
✓Atomic Idempotent Transfer5/541.9s
✓Nested Update3/332s
✓Nested Cascade Delete11/1138.6s
✓Batched Delete4/439.7s
✓Deterministic Context5/528.3s
✓Reducer Result Table2/231.2s

schema

100% · 10 evals
PassTaskChecksRun Time
✓Spacetime Product Type3/331.3s
✓Spacetime Sum Type3/333.3s
✓Elementary Columns3/333.2s
✓Product Type Columns3/324.1s
✓Sum Type Columns3/326.8s
✓Scheduled Columns2/234s
✓Constraints3/336s
✓Many To Many5/537s
✓Ecs7/734.4s
✓Multi Column Index5/535.6s

tables

100% · 8 evals
PassTaskChecksRun Time
✓Normalized Collection1/134.4s
✓Heartbeat Isolation1/131.2s
✓Binary Storage2/235.9s
✓Normalized Schema1/138.8s
✓Denormalized Index4/437.7s
✓Autoinc Reference2/229.9s
✓Default Values2/21m 1s
✓Special Types1/134.8s

views

100% · 7 evals
PassTaskChecksRun Time
✓Three Table Join2/223.4s
✓Semijoin Intersection2/221.7s
✓Timestamp Window2/224.4s
✓Index And Filter2/228.3s
✓Materialized Aggregate2/251.1s
✓Query Builder View2/226.2s
✓View Primary Key2/222s