Loading model details...
Back to Leaderboard
Baidu
ERNIE 4.5 VL 424B A47B
Rank
#49
Overview
Analytics
Score Overview
53.3%
Overall Score
50.0%
Accuracy
100.0%
Syntax Valid
Score Dimensions
59
Correctness
68
Best Practices
70
Performance
69
Clarity
Performance by Complexity
Basic
100.0%
Intermediate
60.0%
Advanced
30.9%
Tasks Correct
15 / 30
Avg Response Time
98356ms
Task Breakdown
Summary
Dimensions
Task
Category
Score
Time
Total Sales Amount
task-001
aggregation
100%
4413ms
Count of Customers
task-002
aggregation
100%
2823ms
Average Unit Price
task-003
aggregation
100%
10941ms
Distinct Product Count
task-004
aggregation
100%
3383ms
Total Order Quantity
task-005
aggregation
100%
3786ms
Year-to-Date Sales
task-006
time intelligence
100%
10337ms
Previous Year Sales
task-007
time intelligence
100%
16408ms
Sales by Category Filter
task-008
filtering
100%
126540ms
Year-over-Year Growth Percentage
task-009
calculation
30%
38221ms
Running Total with CALCULATE and FILTER
task-010
iterator
30%
129083ms
Sales Summary by Category
task-011
table manipulation
30%
111089ms
Product List with Renamed Columns
task-012
table manipulation
100%
4453ms
Union of High-Value Transactions
task-013
table manipulation
100%
52757ms
Year-Category Analysis Matrix
Query Failed
task-014
table manipulation
10%
141234ms
Product Percentage of Category Total
Query Failed
task-015
context transition
10%
263383ms
Virtual Relationship with TREATAS
Query Failed
task-016
context transition
10%
67759ms
Granularity-Aware Measure with VALUES
Query Failed
task-017
context transition
10%
301955ms
Running Count with EARLIER
task-018
context transition
30%
149762ms
Multiple Filter Conditions
task-019
filtering
100%
36849ms
Percentage of Total with ALLEXCEPT
Query Failed
task-020
filtering
10%
226261ms
Filter Intersection with KEEPFILTERS
task-021
filtering
100%
38649ms
Product Ranking with RANKX
Query Failed
task-022
iterator
10%
187783ms
Top 5 Products with TOPN
task-023
table manipulation
30%
263293ms
90th Percentile Order Value
task-024
iterator
30%
40751ms
Handle Missing Data with BLANK
task-025
calculation
100%
7396ms
Safe Ratio with Cascading Fallbacks
task-026
calculation
100%
156534ms
Safe Year-over-Year with Missing Data
Query Failed
task-027
time intelligence
10%
141488ms
3-Month Rolling Average
Query Failed
task-028
time intelligence
10%
220016ms
Same Month Previous Year Comparison
task-029
time intelligence
100%
147706ms
Fiscal Year-to-Date (July Start)
Query Failed
task-030
time intelligence
10%
45616ms