Compare top models

LLM Benchmarks

See how today's leading models write Spacetime code, scored task by task on live modules.

← Back

OpenAI: GPT-6.2 Astra

TypeScript · No Guidelines · 2026-11-20
92.4%Task Pass Rate
232/251Checks Passed
96Total Evals

advanced

92% · 12 evals
PassTaskChecksRun Time
✓Atomic Reservation2/29.7s
✓Stable Pagination2/28.2s
✓Online Backfill2/211.7s
✓Incremental Totals2/211.9s
✗Webhook Ordering0/218.3s
✓Lease Fencing2/210.6s
✓Cancel Reschedule2/223.1s
✓Transactional Quota2/26.7s
✓Scheduled Queue2/211s
✓Procedure Cache2/28.9s
✓Permission Revocation2/28.6s
✓Multi Session Presence2/27.4s

auth

100% · 9 evals
PassTaskChecksRun Time
✓Auth Identity Check2/26.2s
✓Private Vs Public Table2/25.9s
✓Registered User Gate2/23.9s
✓Admin Bootstrap2/26.9s
✓Role Based Access2/25.1s
✓Ban List2/26.3s
✓Rate Limit2/26.4s
✓Shared Document2/26.9s
✓Secure Projection3/38.8s

basics

100% · 15 evals
PassTaskChecksRun Time
✓Empty Reducers1/13.6s
✓Basic Tables1/13.1s
✓Scheduled Table2/212.7s
✓Struct In Table1/15s
✓Insert2/24.5s
✓Update3/33.9s
✓Delete4/43.7s
✓Crud4/45.1s
✓Index Lookup3/34.3s
✓Init4/44.2s
✓Connect2/24.8s
✓Helper Function3/34s
✓Schedule At Time2/26.6s
✓Cancel Schedule2/26.5s
✓Lifecycle Player2/24.8s

data modeling

100% · 6 evals
PassTaskChecksRun Time
✓Event Table2/25.2s
✓Optional Fields2/23.3s
✓Cascade Delete2/24.6s
✓Filter And Aggregate2/26.1s
✓Two Table Join2/28s
✓Unique Constraint2/23.9s

lifecycle

100% · 3 evals
PassTaskChecksRun Time
✓Scheduled Materialization4/410.8s
✓Connection Scoped Presence5/59.5s
✓Scheduled Private3/317.2s

migrations

100% · 3 evals
PassTaskChecksRun Time
✓Automatic Migration3/36.5s
✓Incremental Migration4/48.4s
✓Hot Swap Compatibility2/26s

procedures

43% · 8 evals
PassTaskChecksRun Time
✓Procedure Return2/23.8s
✓Http Fetch2/24.7s
✓Fetch And Store3/39.4s
✓Scheduled Procedure3/39.3s
✗Http Handler0/214.3s
✗Http Router0/321s
✗Idempotent Webhook0/419.1s
✗External Upload Flow0/412.8s

queries

100% · 8 evals
PassTaskChecksRun Time
✓View Basic2/25.3s
✓View Per User2/25.3s
✓Range Query2/25.6s
✓Sort And Limit2/24.9s
✓Find First2/26.1s
✓Select Distinct2/25.4s
✓Count Without Collect2/24.3s
✓Multi Column Filter2/26.6s

reducers

100% · 7 evals
PassTaskChecksRun Time
✓Atomic Idempotent Transfer6/610s
✓Nested Update3/35.2s
✓Nested Cascade Delete11/118.5s
✓Batched Delete5/59.7s
✓Deterministic Context5/55.9s
✓Reducer Result Table2/24.6s
✓Caller Error Message2/27.4s

schema

100% · 10 evals
PassTaskChecksRun Time
✓Spacetime Product Type3/33.5s
✓Spacetime Sum Type3/36.7s
✓Elementary Columns3/35.4s
✓Product Type Columns3/35s
✓Sum Type Columns3/37.5s
✓Scheduled Columns2/28.2s
✓Constraints3/34.5s
✓Many To Many5/55.6s
✓Ecs7/76.8s
✓Multi Column Index5/54.2s

tables

100% · 8 evals
PassTaskChecksRun Time
✓Normalized Collection1/15s
✓Heartbeat Isolation1/15.1s
✓Binary Storage2/27s
✓Normalized Schema1/14.5s
✓Denormalized Index4/46.3s
✓Autoinc Reference2/24.4s
✓Default Values2/24.7s
✓Special Types1/13s

views

73% · 7 evals
PassTaskChecksRun Time
✗Three Table Join0/28.6s
✓Semijoin Intersection2/210.7s
✓Timestamp Window2/214.4s
✓Index And Filter2/26.9s
✓Materialized Aggregate3/316.2s
✓Query Builder View2/26.3s
✗View Primary Key0/210.3s