Community
Compare top models
LLM Benchmarks
See how today's leading models write SpacetimeDB code, scored task by task on live modules.
←
Typescript · With Guidelinesanthropic/claude-sonnet-5
0.0%Task Pass Rate
0/89Checks Passed
47Total Evals
auth
0% · 8 evals| Status | Task ID | Checks | Run Time | |
|---|---|---|---|---|
| ✗ | t_026_auth_identity_check | 0/1 | 7.7s | ▼ |
| ✗ | t_027_private_vs_public_table | 0/1 | 7.7s | ▼ |
| ✗ | t_043_role_based_access | 0/1 | 8.3s | ▼ |
| ✗ | t_041_registered_user_gate | 0/1 | 7.5s | ▼ |
| ✗ | t_042_admin_bootstrap | 0/1 | 7.5s | ▼ |
| ✗ | t_044_ban_list | 0/1 | 8.6s | ▼ |
| ✗ | t_045_rate_limit | 0/1 | 7.7s | ▼ |
| ✗ | t_046_shared_document | 0/1 | 10.4s | ▼ |
basics
0% · 15 evals| Status | Task ID | Checks | Run Time | |
|---|---|---|---|---|
| ✗ | t_000_empty_reducers | 0/1 | 6.4s | ▼ |
| ✗ | t_001_basic_tables | 0/1 | 6.2s | ▼ |
| ✗ | t_002_scheduled_table | 0/1 | 5.7s | ▼ |
| ✗ | t_003_struct_in_table | 0/1 | 4.8s | ▼ |
| ✗ | t_004_insert | 0/2 | 5.0s | ▼ |
| ✗ | t_005_update | 0/3 | 5.9s | ▼ |
| ✗ | t_006_delete | 0/3 | 5.9s | ▼ |
| ✗ | t_007_crud | 0/4 | 6.0s | ▼ |
| ✗ | t_008_index_lookup | 0/3 | 8.9s | ▼ |
| ✗ | t_009_init | 0/4 | 6.2s | ▼ |
| ✗ | t_010_connect | 0/1 | 5.5s | ▼ |
| ✗ | t_011_helper_function | 0/3 | 5.4s | ▼ |
| ✗ | t_038_schedule_at_time | 0/1 | 8.4s | ▼ |
| ✗ | t_039_cancel_schedule | 0/1 | 8.2s | ▼ |
| ✗ | t_040_lifecycle_player | 0/1 | 5.3s | ▼ |
data modeling
0% · 6 evals| Status | Task ID | Checks | Run Time | |
|---|---|---|---|---|
| ✗ | t_024_event_table | 0/1 | 8.3s | ▼ |
| ✗ | t_025_optional_fields | 0/1 | 6.6s | ▼ |
| ✗ | t_028_cascade_delete | 0/1 | 6.9s | ▼ |
| ✗ | t_029_filter_and_aggregate | 0/1 | 8.7s | ▼ |
| ✗ | t_030_two_table_join | 0/1 | 8.4s | ▼ |
| ✗ | t_031_unique_constraint | 0/1 | 5.1s | ▼ |
queries
0% · 8 evals| Status | Task ID | Checks | Run Time | |
|---|---|---|---|---|
| ✗ | t_022_view_basic | 0/1 | 5.5s | ▼ |
| ✗ | t_023_view_per_user | 0/1 | 6.1s | ▼ |
| ✗ | t_032_range_query | 0/1 | 5.6s | ▼ |
| ✗ | t_033_sort_and_limit | 0/1 | 9.4s | ▼ |
| ✗ | t_034_find_first | 0/1 | 5.8s | ▼ |
| ✗ | t_035_select_distinct | 0/1 | 8.5s | ▼ |
| ✗ | t_036_count_without_collect | 0/1 | 6.3s | ▼ |
| ✗ | t_037_multi_column_filter | 0/1 | 7.1s | ▼ |
schema
0% · 10 evals| Status | Task ID | Checks | Run Time | |
|---|---|---|---|---|
| ✗ | t_012_spacetime_product_type | 0/3 | 5.0s | ▼ |
| ✗ | t_013_spacetime_sum_type | 0/3 | 6.3s | ▼ |
| ✗ | t_014_elementary_columns | 0/3 | 5.4s | ▼ |
| ✗ | t_015_product_type_columns | 0/3 | 5.7s | ▼ |
| ✗ | t_016_sum_type_columns | 0/3 | 7.2s | ▼ |
| ✗ | t_017_scheduled_columns | 0/2 | 5.7s | ▼ |
| ✗ | t_018_constraints | 0/3 | 7.5s | ▼ |
| ✗ | t_019_many_to_many | 0/5 | 9.3s | ▼ |
| ✗ | t_020_ecs | 0/7 | 10.1s | ▼ |
| ✗ | t_021_multi_column_index | 0/5 | 6.9s | ▼ |