Loading model details...
Back to Leaderboard
OpenAI
GPT-4o-mini (2024-07-18)
Rank
#19
Overview
Analytics
Score Overview
73.6%
Overall Score
73.3%
Accuracy
100.0%
Syntax Valid
Score Dimensions
77
Correctness
92
Best Practices
78
Performance
77
Clarity
Performance by Complexity
Basic
99.7%
Intermediate
79.2%
Advanced
59.3%
Tasks Correct
22 / 30
Avg Response Time
1466ms
Task Breakdown
Summary
Dimensions
Task
Category
Score
Time
Total Sales Amount
task-001
aggregation
100%
876ms
Count of Customers
task-002
aggregation
100%
761ms
Average Unit Price
task-003
aggregation
100%
893ms
Distinct Product Count
task-004
aggregation
100%
854ms
Total Order Quantity
task-005
aggregation
100%
826ms
Year-to-Date Sales
task-006
time intelligence
100%
1487ms
Previous Year Sales
task-007
time intelligence
100%
1072ms
Sales by Category Filter
task-008
filtering
100%
996ms
Year-over-Year Growth Percentage
Query Failed
task-009
calculation
10%
2735ms
Running Total with CALCULATE and FILTER
Query Failed
task-010
iterator
10%
1737ms
Sales Summary by Category
task-011
table manipulation
100%
1162ms
Product List with Renamed Columns
task-012
table manipulation
100%
1389ms
Union of High-Value Transactions
Query Failed
task-013
table manipulation
10%
1321ms
Year-Category Analysis Matrix
task-014
table manipulation
100%
1126ms
Product Percentage of Category Total
task-015
context transition
30%
2049ms
Virtual Relationship with TREATAS
task-016
context transition
100%
1679ms
Granularity-Aware Measure with VALUES
Query Failed
task-017
context transition
10%
1534ms
Running Count with EARLIER
task-018
context transition
30%
1698ms
Multiple Filter Conditions
task-019
filtering
100%
1826ms
Percentage of Total with ALLEXCEPT
Query Failed
task-020
filtering
10%
1526ms
Filter Intersection with KEEPFILTERS
task-021
filtering
100%
1292ms
Product Ranking with RANKX
task-022
iterator
100%
1284ms
Top 5 Products with TOPN
task-023
table manipulation
100%
1470ms
90th Percentile Order Value
task-024
iterator
100%
1428ms
Handle Missing Data with BLANK
task-025
calculation
100%
994ms
Safe Ratio with Cascading Fallbacks
task-026
calculation
100%
2162ms
Safe Year-over-Year with Missing Data
Query Failed
task-027
time intelligence
10%
3462ms
3-Month Rolling Average
task-028
time intelligence
100%
1493ms
Same Month Previous Year Comparison
task-029
time intelligence
100%
1369ms
Fiscal Year-to-Date (July Start)
task-030
time intelligence
100%
1485ms