Compare top models

LLM Benchmarks

See how today's leading models write Spacetime code, scored task by task on live modules.

OpenAI: GPT-6.1 Sol

TypeScript · With Guidelines · 2026-11-05

100.0%Task Pass Rate

251/251Checks Passed

96Total Evals

100% · 12 evals

Pass	Task	Checks	Run Time
✓	Atomic Reservation	2/2	7.8s
✓	Stable Pagination	2/2	7.7s
✓	Online Backfill	2/2	11.8s
✓	Incremental Totals	2/2	12.2s
✓	Webhook Ordering	2/2	12.3s
✓	Lease Fencing	2/2	9.5s
✓	Cancel Reschedule	2/2	24s
✓	Transactional Quota	2/2	4.7s
✓	Scheduled Queue	2/2	10.9s
✓	Procedure Cache	2/2	12.9s
✓	Permission Revocation	2/2	8.4s
✓	Multi Session Presence	2/2	8.7s

100% · 9 evals

Pass	Task	Checks	Run Time
✓	Auth Identity Check	2/2	3.9s
✓	Private Vs Public Table	2/2	3.9s
✓	Registered User Gate	2/2	4.2s
✓	Admin Bootstrap	2/2	4.3s
✓	Role Based Access	2/2	5s
✓	Ban List	2/2	5s
✓	Rate Limit	2/2	5.6s
✓	Shared Document	2/2	6s
✓	Secure Projection	3/3	5.7s

100% · 15 evals

Pass	Task	Checks	Run Time
✓	Empty Reducers	1/1	3.7s
✓	Basic Tables	1/1	3.3s
✓	Scheduled Table	2/2	6.9s
✓	Struct In Table	1/1	3.2s
✓	Insert	2/2	3.5s
✓	Update	3/3	4.1s
✓	Delete	4/4	4.1s
✓	Crud	4/4	5.1s
✓	Index Lookup	3/3	4.5s
✓	Init	4/4	3.2s
✓	Connect	2/2	3.4s
✓	Helper Function	3/3	3.5s
✓	Schedule At Time	2/2	5.5s
✓	Cancel Schedule	2/2	5.5s
✓	Lifecycle Player	2/2	3.3s

100% · 6 evals

Pass	Task	Checks	Run Time
✓	Event Table	2/2	3.9s
✓	Optional Fields	2/2	3.8s
✓	Cascade Delete	2/2	4.2s
✓	Filter And Aggregate	2/2	4.5s
✓	Two Table Join	2/2	5.5s
✓	Unique Constraint	2/2	3.9s

100% · 3 evals

Pass	Task	Checks	Run Time
✓	Scheduled Materialization	4/4	11.2s
✓	Connection Scoped Presence	5/5	5.8s
✓	Scheduled Private	3/3	6.5s

100% · 3 evals

Pass	Task	Checks	Run Time
✓	Automatic Migration	3/3	5.6s
✓	Incremental Migration	4/4	7.9s
✓	Hot Swap Compatibility	2/2	6.3s

100% · 8 evals

Pass	Task	Checks	Run Time
✓	Procedure Return	2/2	3.1s
✓	Http Fetch	2/2	3.3s
✓	Fetch And Store	3/3	6.1s
✓	Scheduled Procedure	3/3	6.8s
✓	Http Handler	2/2	3.6s
✓	Http Router	3/3	6.7s
✓	Idempotent Webhook	4/4	8.3s
✓	External Upload Flow	4/4	7.4s

100% · 8 evals

Pass	Task	Checks	Run Time
✓	View Basic	2/2	4s
✓	View Per User	2/2	3.2s
✓	Range Query	2/2	4.2s
✓	Sort And Limit	2/2	5.4s
✓	Find First	2/2	4.2s
✓	Select Distinct	2/2	6.3s
✓	Count Without Collect	2/2	4.7s
✓	Multi Column Filter	2/2	5.8s

100% · 7 evals

Pass	Task	Checks	Run Time
✓	Atomic Idempotent Transfer	6/6	7.7s
✓	Nested Update	3/3	4.3s
✓	Nested Cascade Delete	11/11	6.8s
✓	Batched Delete	5/5	10.8s
✓	Deterministic Context	5/5	5.5s
✓	Reducer Result Table	2/2	3.6s
✓	Caller Error Message	2/2	3.3s

100% · 10 evals

Pass	Task	Checks	Run Time
✓	Spacetime Product Type	3/3	3.5s
✓	Spacetime Sum Type	3/3	4.2s
✓	Elementary Columns	3/3	3.8s
✓	Product Type Columns	3/3	3.7s
✓	Sum Type Columns	3/3	4.2s
✓	Scheduled Columns	2/2	5.2s
✓	Constraints	3/3	3.9s
✓	Many To Many	5/5	7.7s
✓	Ecs	7/7	9.4s
✓	Multi Column Index	5/5	4.3s

100% · 8 evals

Pass	Task	Checks	Run Time
✓	Normalized Collection	1/1	4s
✓	Heartbeat Isolation	1/1	4.4s
✓	Binary Storage	2/2	4.1s
✓	Normalized Schema	1/1	4.1s
✓	Denormalized Index	4/4	6.3s
✓	Autoinc Reference	2/2	4.4s
✓	Default Values	2/2	5.4s
✓	Special Types	1/1	4s

100% · 7 evals

Pass	Task	Checks	Run Time
✓	Three Table Join	2/2	6.7s
✓	Semijoin Intersection	2/2	4.2s
✓	Timestamp Window	2/2	6.4s
✓	Index And Filter	2/2	4.4s
✓	Materialized Aggregate	3/3	18.2s
✓	Query Builder View	2/2	3.7s
✓	View Primary Key	2/2	6.3s