Compare top models

LLM Benchmarks

See how today's leading models write Spacetime code, scored task by task on live modules.

← Back

Google: Gemini 4 Hydrogen

TypeScript · No Guidelines · 2026-11-20
50.6%Task Pass Rate
127/251Checks Passed
96Total Evals

advanced

25% · 12 evals
PassTaskChecksRun Time
✗Atomic Reservation0/220.5s
✗Stable Pagination0/219.3s
✓Online Backfill2/232s
✓Incremental Totals2/222.9s
✗Webhook Ordering0/248.7s
✗Lease Fencing0/229.8s
✗Cancel Reschedule0/235.1s
✓Transactional Quota2/219.3s
✗Scheduled Queue0/242s
✗Procedure Cache0/231.3s
✗Permission Revocation0/221.1s
✗Multi Session Presence0/233.4s

auth

42% · 9 evals
PassTaskChecksRun Time
✗Auth Identity Check0/215s
✓Private Vs Public Table2/28.4s
✗Registered User Gate0/214.7s
✓Admin Bootstrap2/210.5s
✗Role Based Access0/213.2s
✗Ban List0/220.5s
✓Rate Limit2/215.5s
✓Shared Document2/215s
✗Secure Projection0/316.6s

basics

61% · 15 evals
PassTaskChecksRun Time
✗Empty Reducers0/111.4s
✓Basic Tables1/111.6s
✗Scheduled Table0/216.6s
✓Struct In Table1/112.6s
✓Insert2/213.9s
✗Update0/313.4s
✓Delete4/49s
✗Crud0/416.5s
✓Index Lookup3/320.4s
✓Init4/49.2s
✓Connect2/212s
✓Helper Function3/39.5s
✗Schedule At Time0/219.7s
✗Cancel Schedule0/218s
✓Lifecycle Player2/213.1s

data modeling

67% · 6 evals
PassTaskChecksRun Time
✓Event Table2/28.6s
✓Optional Fields2/28s
✗Cascade Delete0/210.5s
✗Filter And Aggregate0/223s
✓Two Table Join2/210s
✓Unique Constraint2/27.9s

lifecycle

42% · 3 evals
PassTaskChecksRun Time
✗Scheduled Materialization0/424.5s
✓Connection Scoped Presence5/518.6s
✗Scheduled Private0/329.1s

migrations

100% · 3 evals
PassTaskChecksRun Time
✓Automatic Migration3/310.5s
✓Incremental Migration4/412.9s
✓Hot Swap Compatibility2/210.2s

procedures

0% · 8 evals
PassTaskChecksRun Time
✗Procedure Return0/215.1s
✗Http Fetch0/215.7s
✗Fetch And Store0/317.8s
✗Scheduled Procedure0/332.6s
✗Http Handler0/239.2s
✗Http Router0/336.5s
✗Idempotent Webhook0/41m 2s
✗External Upload Flow0/41m 1s

queries

88% · 8 evals
PassTaskChecksRun Time
✓View Basic2/213.3s
✓View Per User2/211.3s
✓Range Query2/210.5s
✓Sort And Limit2/212s
✓Find First2/29.7s
✓Select Distinct2/213.1s
✓Count Without Collect2/212.1s
✗Multi Column Filter0/215.9s

reducers

76% · 7 evals
PassTaskChecksRun Time
✓Atomic Idempotent Transfer6/614.6s
✗Nested Update0/312.2s
✓Nested Cascade Delete11/1122.2s
✗Batched Delete0/524.1s
✓Deterministic Context5/549.6s
✓Reducer Result Table2/29.3s
✓Caller Error Message2/28s

schema

57% · 10 evals
PassTaskChecksRun Time
✓Spacetime Product Type3/312.4s
✓Spacetime Sum Type3/313s
✗Elementary Columns0/317.8s
✗Product Type Columns0/310.4s
✓Sum Type Columns3/317.7s
✗Scheduled Columns0/222s
✗Constraints0/312.8s
✗Many To Many0/515.4s
✓Ecs7/719.7s
✓Multi Column Index5/518.3s

tables

29% · 8 evals
PassTaskChecksRun Time
✗Normalized Collection0/110.2s
✓Heartbeat Isolation1/113.5s
✗Binary Storage0/218.5s
✗Normalized Schema0/116.9s
✗Denormalized Index0/415.6s
✗Autoinc Reference0/210s
✓Default Values2/27.8s
✓Special Types1/19.3s

views

27% · 7 evals
PassTaskChecksRun Time
✗Three Table Join0/228.8s
✓Semijoin Intersection2/220.9s
✗Timestamp Window0/234.7s
✓Index And Filter2/216.5s
✗Materialized Aggregate0/329.2s
✗Query Builder View0/214.9s
✗View Primary Key0/225.1s