Compare top models

LLM Benchmarks

See how today's leading models write Spacetime code, scored task by task on live modules.

← Back

DeepSeek: DeepSeek V4.1 Flash 1017

TypeScript · With Guidelines · 2026-11-05
97.2%Task Pass Rate
244/251Checks Passed
96Total Evals

advanced

100% · 12 evals
PassTaskChecksRun Time
✓Atomic Reservation2/210.1s
✓Stable Pagination2/210.6s
✓Online Backfill2/222s
✓Incremental Totals2/228.4s
✓Webhook Ordering2/221.4s
✓Lease Fencing2/212.1s
✓Cancel Reschedule2/247.3s
✓Transactional Quota2/29.9s
✓Scheduled Queue2/215.2s
✓Procedure Cache2/221.9s
✓Permission Revocation2/214.8s
✓Multi Session Presence2/211.3s

auth

100% · 9 evals
PassTaskChecksRun Time
✓Auth Identity Check2/22.7s
✓Private Vs Public Table2/23.2s
✓Registered User Gate2/22.5s
✓Admin Bootstrap2/24.2s
✓Role Based Access2/22.9s
✓Ban List2/25.6s
✓Rate Limit2/24.3s
✓Shared Document2/27.7s
✓Secure Projection3/38.3s

basics

100% · 15 evals
PassTaskChecksRun Time
✓Empty Reducers1/12.7s
✓Basic Tables1/15s
✓Scheduled Table2/211.1s
✓Struct In Table1/11.9s
✓Insert2/22.3s
✓Update3/32.8s
✓Delete4/46.7s
✓Crud4/42.4s
✓Index Lookup3/33.1s
✓Init4/45.4s
✓Connect2/22s
✓Helper Function3/32.2s
✓Schedule At Time2/27.9s
✓Cancel Schedule2/210.7s
✓Lifecycle Player2/23.7s

data modeling

83% · 6 evals
PassTaskChecksRun Time
✗Event Table0/23s
✓Optional Fields2/22.3s
✓Cascade Delete2/23s
✓Filter And Aggregate2/27.8s
✓Two Table Join2/23.2s
✓Unique Constraint2/22.6s

lifecycle

100% · 3 evals
PassTaskChecksRun Time
✓Scheduled Materialization4/48.5s
✓Connection Scoped Presence5/54.6s
✓Scheduled Private3/38.2s

migrations

100% · 3 evals
PassTaskChecksRun Time
✓Automatic Migration3/36s
✓Incremental Migration4/47.2s
✓Hot Swap Compatibility2/25.8s

procedures

100% · 8 evals
PassTaskChecksRun Time
✓Procedure Return2/22.7s
✓Http Fetch2/23.9s
✓Fetch And Store3/312.8s
✓Scheduled Procedure3/37s
✓Http Handler2/26.3s
✓Http Router3/36.4s
✓Idempotent Webhook4/414.6s
✓External Upload Flow4/417.7s

queries

100% · 8 evals
PassTaskChecksRun Time
✓View Basic2/215.2s
✓View Per User2/23.8s
✓Range Query2/24.6s
✓Sort And Limit2/27.3s
✓Find First2/24.5s
✓Select Distinct2/22.8s
✓Count Without Collect2/24.2s
✓Multi Column Filter2/26.6s

reducers

85% · 7 evals
PassTaskChecksRun Time
✓Atomic Idempotent Transfer6/611.1s
✓Nested Update3/39.2s
✓Nested Cascade Delete11/1110s
✓Batched Delete5/518.4s
✗Deterministic Context0/51.5s
✓Reducer Result Table2/22.4s
✓Caller Error Message2/22.1s

schema

100% · 10 evals
PassTaskChecksRun Time
✓Spacetime Product Type3/32.8s
✓Spacetime Sum Type3/35.4s
✓Elementary Columns3/32.2s
✓Product Type Columns3/32.9s
✓Sum Type Columns3/32.7s
✓Scheduled Columns2/29.1s
✓Constraints3/34.7s
✓Many To Many5/57.2s
✓Ecs7/76.4s
✓Multi Column Index5/53.9s

tables

100% · 8 evals
PassTaskChecksRun Time
✓Normalized Collection1/11.8s
✓Heartbeat Isolation1/14.4s
✓Binary Storage2/25.8s
✓Normalized Schema1/12.9s
✓Denormalized Index4/46.7s
✓Autoinc Reference2/23.7s
✓Default Values2/25.2s
✓Special Types1/13.6s

views

100% · 7 evals
PassTaskChecksRun Time
✓Three Table Join2/24s
✓Semijoin Intersection2/25.1s
✓Timestamp Window2/27.3s
✓Index And Filter2/24.9s
✓Materialized Aggregate3/322.2s
✓Query Builder View2/24.5s
✓View Primary Key2/220.3s