Compare top models

LLM Benchmarks

See how today's leading models write Spacetime code, scored task by task on live modules.

← Back

Qwen: Qwen4 Max

TypeScript · No Guidelines · 2026-11-20
58.6%Task Pass Rate
147/251Checks Passed
96Total Evals

advanced

38% · 12 evals
PassTaskChecksRun Time
✗Atomic Reservation1/222.4s
✗Stable Pagination0/223.4s
✓Online Backfill2/247.2s
✓Incremental Totals2/224.3s
✗Webhook Ordering0/22m 9s
✓Lease Fencing2/247.3s
✗Cancel Reschedule0/23m 28s
✗Transactional Quota1/228s
✗Scheduled Queue0/23m 32s
✗Procedure Cache0/21m 47s
✗Permission Revocation0/21m 30s
✗Multi Session Presence1/237.5s

auth

100% · 9 evals
PassTaskChecksRun Time
✓Auth Identity Check2/211.9s
✓Private Vs Public Table2/212.9s
✓Registered User Gate2/214.5s
✓Admin Bootstrap2/216.8s
✓Role Based Access2/211.6s
✓Ban List2/215.8s
✓Rate Limit2/217.2s
✓Shared Document2/216.8s
✓Secure Projection3/313.7s

basics

83% · 15 evals
PassTaskChecksRun Time
✓Empty Reducers1/110.1s
✓Basic Tables1/17.8s
✗Scheduled Table0/22m 29s
✓Struct In Table1/18.2s
✓Insert2/27.1s
✓Update3/312.6s
✓Delete4/48.6s
✓Crud4/414.5s
✓Index Lookup3/311.9s
✓Init4/415.8s
✓Connect2/210.3s
✓Helper Function3/38s
✗Schedule At Time0/216.5s
✗Cancel Schedule0/21m 33s
✓Lifecycle Player2/29.3s

data modeling

83% · 6 evals
PassTaskChecksRun Time
✓Event Table2/27.6s
✓Optional Fields2/211.4s
✗Cascade Delete0/216.2s
✓Filter And Aggregate2/222.6s
✓Two Table Join2/216.2s
✓Unique Constraint2/217.8s

lifecycle

42% · 3 evals
PassTaskChecksRun Time
✗Scheduled Materialization0/442.8s
✓Connection Scoped Presence5/52m 24s
✗Scheduled Private0/31m 7s

migrations

100% · 3 evals
PassTaskChecksRun Time
✓Automatic Migration3/38.5s
✓Incremental Migration4/412.5s
✓Hot Swap Compatibility2/210.1s

procedures

9% · 8 evals
PassTaskChecksRun Time
✓Procedure Return2/222.5s
✗Http Fetch0/254.1s
✗Fetch And Store0/330.3s
✗Scheduled Procedure0/31m 25s
✗Http Handler0/240s
✗Http Router0/354.2s
✗Idempotent Webhook0/41m 43s
✗External Upload Flow0/41m 2s

queries

75% · 8 evals
PassTaskChecksRun Time
✗View Basic0/223.2s
✗View Per User0/217.1s
✓Range Query2/214.4s
✓Sort And Limit2/222.1s
✓Find First2/221.4s
✓Select Distinct2/212s
✓Count Without Collect2/219s
✓Multi Column Filter2/229.5s

reducers

68% · 7 evals
PassTaskChecksRun Time
✓Atomic Idempotent Transfer6/619.7s
✓Nested Update3/325.7s
✓Nested Cascade Delete11/1115.1s
✗Batched Delete0/551.8s
✗Deterministic Context0/51m 21s
✓Reducer Result Table2/210.9s
✗Caller Error Message1/212.3s

schema

43% · 10 evals
PassTaskChecksRun Time
✓Spacetime Product Type3/38.6s
✗Spacetime Sum Type0/315.3s
✓Elementary Columns3/39.1s
✗Product Type Columns0/310.6s
✓Sum Type Columns3/315.8s
✗Scheduled Columns0/235.7s
✗Constraints0/314.3s
✗Many To Many0/518.3s
✓Ecs7/715.9s
✗Multi Column Index0/511.4s

tables

57% · 8 evals
PassTaskChecksRun Time
✓Normalized Collection1/18.9s
✓Heartbeat Isolation1/18.9s
✓Binary Storage2/215.4s
✓Normalized Schema1/126.9s
✗Denormalized Index0/444.1s
✗Autoinc Reference0/212.7s
✓Default Values2/210.7s
✓Special Types1/18.7s

views

27% · 7 evals
PassTaskChecksRun Time
✗Three Table Join0/21m 48s
✗Semijoin Intersection0/234.3s
✗Timestamp Window0/254.7s
✓Index And Filter2/237.7s
✗Materialized Aggregate0/31m 30s
✗Query Builder View0/223.6s
✓View Primary Key2/227s