Community
Compare top models
LLM Benchmarks
See how today's leading models write SpacetimeDB code, scored task by task on live modules.
←
Typescript · With Guidelinesgoogle/gemini-3-flash-preview
97.8%Task Pass Rate
87/89Checks Passed
47Total Evals
Pass Rate Over Time
Click a data point to view results from that date.
auth
100% · 8 evals| Status | Task ID | Checks | Run Time | |
|---|---|---|---|---|
| ✓ | t_045_rate_limit | 1/1 | 4m 43s | ▼ |
| ✓ | t_026_auth_identity_check | 1/1 | 4m 54s | ▼ |
| ✓ | t_027_private_vs_public_table | 1/1 | 15.2s | ▼ |
| ✓ | t_041_registered_user_gate | 1/1 | 5m 23s | ▼ |
| ✓ | t_042_admin_bootstrap | 1/1 | 22.5s | ▼ |
| ✓ | t_043_role_based_access | 1/1 | 29.3s | ▼ |
| ✓ | t_044_ban_list | 1/1 | 5m 30s | ▼ |
| ✓ | t_046_shared_document | 1/1 | 6m 5s | ▼ |
basics
97% · 15 evals| Status | Task ID | Checks | Run Time | |
|---|---|---|---|---|
| ✓ | t_000_empty_reducers | 1/1 | 11.7s | ▼ |
| ✓ | t_001_basic_tables | 1/1 | 9.1s | ▼ |
| ✓ | t_002_scheduled_table | 1/1 | 5m 29s | ▼ |
| ✗ | t_003_struct_in_table | 0/1 | 10.1s | ▼ |
| ✓ | t_004_insert | 2/2 | 11.9s | ▼ |
| ✓ | t_005_update | 3/3 | 13.3s | ▼ |
| ✓ | t_006_delete | 3/3 | 11.7s | ▼ |
| ✓ | t_007_crud | 4/4 | 13.0s | ▼ |
| ✓ | t_008_index_lookup | 3/3 | 18.8s | ▼ |
| ✓ | t_009_init | 4/4 | 10.1s | ▼ |
| ✓ | t_010_connect | 1/1 | 15.1s | ▼ |
| ✓ | t_011_helper_function | 3/3 | 12.1s | ▼ |
| ✓ | t_038_schedule_at_time | 1/1 | 11.9s | ▼ |
| ✓ | t_039_cancel_schedule | 1/1 | 13.9s | ▼ |
| ✓ | t_040_lifecycle_player | 1/1 | 15.6s | ▼ |
data modeling
100% · 6 evals| Status | Task ID | Checks | Run Time | |
|---|---|---|---|---|
| ✓ | t_029_filter_and_aggregate | 1/1 | 22.1s | ▼ |
| ✓ | t_030_two_table_join | 1/1 | 4m 47s | ▼ |
| ✓ | t_024_event_table | 1/1 | 14.4s | ▼ |
| ✓ | t_025_optional_fields | 1/1 | 13.6s | ▼ |
| ✓ | t_028_cascade_delete | 1/1 | 22.1s | ▼ |
| ✓ | t_031_unique_constraint | 1/1 | 14.4s | ▼ |
queries
88% · 8 evals| Status | Task ID | Checks | Run Time | |
|---|---|---|---|---|
| ✗ | t_022_view_basic | 0/1 | 14.0s | ▼ |
| ✓ | t_023_view_per_user | 1/1 | 15.7s | ▼ |
| ✓ | t_032_range_query | 1/1 | 26.1s | ▼ |
| ✓ | t_033_sort_and_limit | 1/1 | 4m 50s | ▼ |
| ✓ | t_034_find_first | 1/1 | 18.3s | ▼ |
| ✓ | t_035_select_distinct | 1/1 | 15.1s | ▼ |
| ✓ | t_036_count_without_collect | 1/1 | 34.0s | ▼ |
| ✓ | t_037_multi_column_filter | 1/1 | 22.7s | ▼ |
schema
100% · 10 evals| Status | Task ID | Checks | Run Time | |
|---|---|---|---|---|
| ✓ | t_012_spacetime_product_type | 3/3 | 12.5s | ▼ |
| ✓ | t_013_spacetime_sum_type | 3/3 | 11.8s | ▼ |
| ✓ | t_014_elementary_columns | 3/3 | 12.4s | ▼ |
| ✓ | t_015_product_type_columns | 3/3 | 19.7s | ▼ |
| ✓ | t_016_sum_type_columns | 3/3 | 14.4s | ▼ |
| ✓ | t_017_scheduled_columns | 2/2 | 5m 47s | ▼ |
| ✓ | t_018_constraints | 3/3 | 12.8s | ▼ |
| ✓ | t_019_many_to_many | 5/5 | 5m 31s | ▼ |
| ✓ | t_020_ecs | 7/7 | 25.9s | ▼ |
| ✓ | t_021_multi_column_index | 5/5 | 14.4s | ▼ |