Compare top models

LLM Benchmarks

See how today's leading models write Spacetime code, scored task by task on live modules.

← Back

OpenAI: GPT-6 Sol

TypeScript · With Guidelines · 2026-09-28
99.5%Task Pass Rate
189/190Checks Passed
83Total Evals

auth

100% · 9 evals
PassTaskChecksRun Time
✓Auth Identity Check1/112.5s
✓Private Vs Public Table1/17.2s
✓Registered User Gate1/116.1s
✓Admin Bootstrap1/112.7s
✓Role Based Access1/113.1s
✓Ban List1/113.6s
✓Rate Limit1/111.4s
✓Shared Document1/116s
✓Secure Projection2/219s

basics

100% · 15 evals
PassTaskChecksRun Time
✓Empty Reducers1/118.4s
✓Basic Tables1/18.8s
✓Scheduled Table1/124.1s
✓Struct In Table1/18.8s
✓Insert2/28.8s
✓Update3/313.1s
✓Delete3/317.3s
✓Crud4/417.3s
✓Index Lookup3/313.1s
✓Init4/411.9s
✓Connect1/18.7s
✓Helper Function3/319.5s
✓Schedule At Time1/117.3s
✓Cancel Schedule1/118.9s
✓Lifecycle Player1/112.8s

data modeling

100% · 6 evals
PassTaskChecksRun Time
✓Event Table1/112s
✓Optional Fields1/112.3s
✓Cascade Delete1/112.1s
✓Filter And Aggregate1/119.2s
✓Two Table Join1/120s
✓Unique Constraint1/19.4s

lifecycle

100% · 3 evals
PassTaskChecksRun Time
✓Scheduled Materialization4/429.1s
✓Connection Scoped Presence4/419.2s
✓Scheduled Private3/319.2s

migrations

100% · 3 evals
PassTaskChecksRun Time
✓Automatic Migration3/322.9s
✓Incremental Migration4/423s
✓Hot Swap Compatibility2/222.9s

procedures

100% · 8 evals
PassTaskChecksRun Time
✓Procedure Return2/26.2s
✓Http Fetch2/29.3s
✓Fetch And Store3/310.9s
✓Scheduled Procedure3/316s
✓Http Handler2/29.1s
✓Http Router2/210.2s
✓Idempotent Webhook3/318.1s
✓External Upload Flow4/413.8s

queries

100% · 8 evals
PassTaskChecksRun Time
✓View Basic1/19.8s
✓View Per User1/111.8s
✓Range Query1/19.8s
✓Sort And Limit1/111.5s
✓Find First1/111.7s
✓Select Distinct1/117.8s
✓Count Without Collect1/116.4s
✓Multi Column Filter1/117.8s

reducers

100% · 6 evals
PassTaskChecksRun Time
✓Atomic Idempotent Transfer5/516.2s
✓Nested Update3/39s
✓Nested Cascade Delete11/1117.8s
✓Batched Delete4/424.7s
✓Deterministic Context5/511.5s
✓Reducer Result Table2/210.3s

schema

100% · 10 evals
PassTaskChecksRun Time
✓Spacetime Product Type3/39.4s
✓Spacetime Sum Type3/321s
✓Elementary Columns3/317.9s
✓Product Type Columns3/312.7s
✓Sum Type Columns3/313.5s
✓Scheduled Columns2/29.8s
✓Constraints3/39s
✓Many To Many5/516.3s
✓Ecs7/721.4s
✓Multi Column Index5/513.4s

tables

100% · 8 evals
PassTaskChecksRun Time
✓Normalized Collection1/121.1s
✓Heartbeat Isolation1/115.9s
✓Binary Storage2/217.9s
✓Normalized Schema1/115.9s
✓Denormalized Index4/421.6s
✓Autoinc Reference2/220.4s
✓Default Values2/215.9s
✓Special Types1/18.7s

views

93% · 7 evals
PassTaskChecksRun Time
✗Three Table Join1/220.5s
✓Semijoin Intersection2/215.3s
✓Timestamp Window2/215.3s
✓Index And Filter2/216.7s
✓Materialized Aggregate2/232.7s
✓Query Builder View2/216.1s
✓View Primary Key2/219.6s