Compare top models

LLM Benchmarks

See how today's leading models write SpacetimeDB code, scored task by task on live modules.

x-ai/grok-4.5

Typescript · With Guidelines
100.0%Task Pass Rate
89/89Checks Passed
47Total Evals

Pass Rate Over Time

Click a data point to view results from that date.

auth

100% · 8 evals
StatusTask IDChecksRun Time
t_041_registered_user_gate1/19.9s
t_042_admin_bootstrap1/113.9s
t_043_role_based_access1/115.8s
t_044_ban_list1/119.7s
t_045_rate_limit1/17.4s
t_046_shared_document1/19.3s
t_026_auth_identity_check1/114.9s
t_027_private_vs_public_table1/17.3s

basics

100% · 15 evals
StatusTask IDChecksRun Time
t_000_empty_reducers1/16.3s
t_001_basic_tables1/16.6s
t_002_scheduled_table1/114.3s
t_003_struct_in_table1/16.9s
t_038_schedule_at_time1/123.7s
t_039_cancel_schedule1/121.4s
t_040_lifecycle_player1/18.3s
t_004_insert2/26.6s
t_005_update3/35.8s
t_006_delete3/34.7s
t_007_crud4/46.3s
t_008_index_lookup3/36.3s
t_009_init4/45.9s
t_010_connect1/14.2s
t_011_helper_function3/37.8s

data modeling

100% · 6 evals
StatusTask IDChecksRun Time
t_030_two_table_join1/110.2s
t_031_unique_constraint1/17.4s
t_024_event_table1/114.2s
t_025_optional_fields1/19.9s
t_028_cascade_delete1/114.2s
t_029_filter_and_aggregate1/110.2s

queries

100% · 8 evals
StatusTask IDChecksRun Time
t_032_range_query1/112.2s
t_033_sort_and_limit1/116.0s
t_034_find_first1/113.6s
t_035_select_distinct1/110.4s
t_036_count_without_collect1/19.2s
t_037_multi_column_filter1/16.6s
t_022_view_basic1/115.7s
t_023_view_per_user1/111.5s

schema

100% · 10 evals
StatusTask IDChecksRun Time
t_012_spacetime_product_type3/311.3s
t_013_spacetime_sum_type3/310.5s
t_014_elementary_columns3/38.9s
t_015_product_type_columns3/311.3s
t_016_sum_type_columns3/310.2s
t_017_scheduled_columns2/216.8s
t_018_constraints3/38.7s
t_019_many_to_many5/520.8s
t_020_ecs7/721.6s
t_021_multi_column_index5/59.0s