Compare top models

LLM Benchmarks

See how today's leading models write Spacetime code, scored task by task on live modules.

← Back

OpenAI: GPT-6 Astra

TypeScript · With Guidelines · 2026-09-28
99.5%Task Pass Rate
189/190Checks Passed
83Total Evals

Pass Rate Over Time

Click a data point to view results from that date.

auth

100% · 9 evals
PassTaskChecksRun Time
✓Auth Identity Check1/19.2s
✓Private Vs Public Table1/117.2s
✓Registered User Gate1/18.3s
✓Admin Bootstrap1/19.3s
✓Role Based Access1/111s
✓Ban List1/112.9s
✓Rate Limit1/19.4s
✓Shared Document1/113.2s
✓Secure Projection2/210.2s

basics

100% · 15 evals
PassTaskChecksRun Time
✓Empty Reducers1/18.7s
✓Basic Tables1/114.1s
✓Scheduled Table1/112.2s
✓Struct In Table1/111.5s
✓Insert2/28.6s
✓Update3/314.5s
✓Delete3/313s
✓Crud4/410.6s
✓Index Lookup3/316.9s
✓Init4/412.2s
✓Connect1/110.6s
✓Helper Function3/38.7s
✓Schedule At Time1/113s
✓Cancel Schedule1/113.6s
✓Lifecycle Player1/113.1s

data modeling

100% · 6 evals
PassTaskChecksRun Time
✓Event Table1/116.7s
✓Optional Fields1/116.7s
✓Cascade Delete1/114.6s
✓Filter And Aggregate1/114.3s
✓Two Table Join1/120.6s
✓Unique Constraint1/18.3s

lifecycle

100% · 3 evals
PassTaskChecksRun Time
✓Scheduled Materialization4/422s
✓Connection Scoped Presence4/414.6s
✓Scheduled Private3/328.5s

migrations

100% · 3 evals
PassTaskChecksRun Time
✓Automatic Migration3/319.6s
✓Incremental Migration4/419.6s
✓Hot Swap Compatibility2/219.6s

procedures

100% · 8 evals
PassTaskChecksRun Time
✓Procedure Return2/213.4s
✓Http Fetch2/213.4s
✓Fetch And Store3/318.4s
✓Scheduled Procedure3/317.4s
✓Http Handler2/213.4s
✓Http Router2/27.8s
✓Idempotent Webhook3/325.1s
✓External Upload Flow4/417.4s

queries

88% · 8 evals
PassTaskChecksRun Time
✗View Basic0/119.6s
✓View Per User1/122.9s
✓Range Query1/116.2s
✓Sort And Limit1/119.6s
✓Find First1/118.9s
✓Select Distinct1/118.9s
✓Count Without Collect1/123s
✓Multi Column Filter1/118.9s

reducers

100% · 6 evals
PassTaskChecksRun Time
✓Atomic Idempotent Transfer5/526.7s
✓Nested Update3/314.9s
✓Nested Cascade Delete11/1115.9s
✓Batched Delete4/422.7s
✓Deterministic Context5/512.3s
✓Reducer Result Table2/26.3s

schema

100% · 10 evals
PassTaskChecksRun Time
✓Spacetime Product Type3/39.4s
✓Spacetime Sum Type3/313.4s
✓Elementary Columns3/39.7s
✓Product Type Columns3/313s
✓Sum Type Columns3/316.7s
✓Scheduled Columns2/219.6s
✓Constraints3/39.3s
✓Many To Many5/532.3s
✓Ecs7/732.3s
✓Multi Column Index5/516.7s

tables

100% · 8 evals
PassTaskChecksRun Time
✓Normalized Collection1/115.6s
✓Heartbeat Isolation1/111.9s
✓Binary Storage2/212.4s
✓Normalized Schema1/118.9s
✓Denormalized Index4/421.2s
✓Autoinc Reference2/215.6s
✓Default Values2/217.1s
✓Special Types1/18.5s

views

100% · 7 evals
PassTaskChecksRun Time
✓Three Table Join2/223.3s
✓Semijoin Intersection2/216s
✓Timestamp Window2/216.4s
✓Index And Filter2/218.9s
✓Materialized Aggregate2/231.1s
✓Query Builder View2/216.4s
✓View Primary Key2/216.4s