Loading model details...
Anthropic
Claude Haiku 4.5
AutoRank
#64
Score Overview
36.96%
Overall Score
41.49%
Accuracy
77.66%
Syntax Valid
Score Dimensions
53.42
Correctness52.48
Best Practices50.63
Performance53.36
ClarityPerformance by Complexity
Basic
83.14%
Intermediate
36.19%
Advanced
11.39%
Tasks Correct
39 / 94
Truncated
0 / 94
Looped
0 / 94
Avg Response Time
1886ms
Temperature
0
Task Breakdown
94 of 94 tasks
Task
Category
Score
Probes
Calculation from a Calculated Column
V2-0201-A · Write measure · basicAggregation
98.4%
4/4
Calculation with an Iterator
V2-0201-B · Write measure · basicRow Context & Context Transition
98.25%
4/4
Ratio of Two Calculations
V2-0201-C · Write measure · basicFoundations & Scalar Expressions
98.25%
5/5
Row-Level Calculated Column
V2-0201-D · Write calculated column · basicFoundations & Scalar Expressions
99.25%
3/3
Sort Key Calculated Column
V2-0202-A · Write calculated column · basicFoundations & Scalar Expressions
98.5%
3/3
Banding Label Calculated Column
V2-0202-B · Write calculated column · basicFoundations & Scalar Expressions
99.25%
3/3
Calculation from Measures
V2-0203 · Write measure · basicFoundations & Scalar Expressions
98.25%
5/5
Measure Filtered by Attribute and Year
V2-0302-A · Write measure · basicIncorrect
Filter Context & CALCULATE
0%
0/5
Measure Filtered by Attribute and a Later Year
V2-0302-B · Write measure · basicFilter Context & CALCULATE
99.25%
5/5
Growth Between Two Filtered Measures
V2-0302-C · Write measure · basicFoundations & Scalar Expressions
99%
4/4
Repair a Year Range Filter
V2-0303 · Fix · intermediateIncorrect
Filter Context & CALCULATE
0%
3/5
Measure Filtered by a Group of Values
V2-0304-A · Write measure · intermediateIncorrect
Filter Context & CALCULATE
0%
0/4
Percentage over a Filtered Total
V2-0304-B · Write measure · basicFoundations & Scalar Expressions
100%
3/3
Total Ignoring Filters
V2-0305-A · Write measure · basicFilter Context & CALCULATE
100%
5/5
Share of the Unfiltered Total
V2-0305-B · Write measure · basicFoundations & Scalar Expressions
99.25%
4/4
Threshold-Based Colour Measure
V2-0305-C · Write measure · basicFoundations & Scalar Expressions
99.25%
4/4
Entities Active in Two Years
V2-0401 · Write measure · intermediateIncorrect
Filter Context & CALCULATE
0%
3/6
Filter with OR Across Columns
V2-0403 · Write measure · intermediateIncorrect
Filter Context & CALCULATE
0%
0/6
Percentage over the Year Total
V2-0404 · Write measure · intermediateIncorrect
Filter Context & CALCULATE
0%
2/6
Measure by an Attribute of a Related Table
V2-0405-A · Write measure · advancedFilter Context & CALCULATE
98.25%
5/5
Filtered Measure by an Attribute of a Related Table
V2-0405-B · Write measure · advancedIncorrect
Filter Context & CALCULATE
0%
0/5
Filtered Share by an Attribute of a Related Table
V2-0405-C · Write measure · basicFoundations & Scalar Expressions
100%
4/4
Maximum of a Row-Level Calculation
V2-0501 · Write measure · intermediateRow Context & Context Transition
97.45%
4/4
Measure in the First Period
V2-0502 · Write measure · advancedIncorrect
Row Context & Context Transition
0%
0/5
Measure for Other Entities Sharing an Attribute
V2-0503 · Write calculated column · intermediateIncorrect
Row Context & Context Transition
0%
0/3
Activity-Based Clustering Column
V2-0504 · Write calculated column · intermediateRelationships & Model Semantics
93.8%
3/3
Average per Group of Entities
V2-0505 · Write measure · intermediateAggregation
97.65%
5/5
Count of Entities Meeting a Condition
V2-0601-A · Write measure · intermediateTable Expressions
100%
4/4
Measure for Entities Meeting a Condition
V2-0601-B · Write measure · intermediateTable Expressions
98%
4/4
Repair a Denominator Ignoring a Column Filter
V2-0602 · Fix · intermediateIncorrect
Relationships & Model Semantics
0%
1/4
Optimize an Iteration
V2-0603 · Fix & optimize · intermediateIncorrect
Row Context & Context Transition
0%
3/3
Attribute Values with Activity
V2-0604 · Write measure · intermediateIncorrect
Table Expressions
0%
1/4
Measure for the Top Entities
V2-0605 · Write measure · advancedTable Expressions
98.8%
5/5
Repair a Count of Top Entities
V2-0701 · Fix · intermediateIncorrect
Row Context & Context Transition
0%
0/4
Refactor a Measure with Variables
V2-0702 · Fix & optimize · intermediateFoundations & Scalar Expressions
97.6%
4/4
Self-Contained Classification Measure
V2-0703 · Write calculated column · advancedAnalytical Patterns
88.6%
3/3
Filter with Expanded Filter Syntax
V2-0801-A · Write measure · intermediateIncorrect
Filter Context & CALCULATE
0%
0/4
Filter via TREATAS
V2-0801-B · Write measure · intermediateFilter Context & CALCULATE
99.25%
4/4
Filter Intersecting the Existing Filter
V2-0801-C · Write measure · intermediateIncorrect
Filter Context & CALCULATE
0%
1/4
Measure over an Inactive Relationship
V2-0802 · Write measure · intermediateRelationships & Model Semantics
99.2%
4/4
Attribute Values Filtered Across Tables
V2-0803 · Write measure · intermediateIncorrect
Relationships & Model Semantics
0%
0/5
Measure on Each Entity's First Day
V2-0804 · Write measure · advancedIncorrect
Format not followedTable Expressions
0%
0/4
Repair a Top-Entity Measure
V2-0805 · Fix · intermediateIncorrect
Row Context & Context Transition
0%
0/5
Share of the Parent Category
V2-0806 · Write calculated column · intermediateIncorrect
Row Context & Context Transition
0%
0/3
Repair a Per-Line Calculation
V2-0807 · Fix · intermediateRow Context & Context Transition
99%
4/4
Filter with OR Across Tables
V2-0809 · Write measure · advancedIncorrect
Table Expressions
0%
0/5
Repair a Threshold Filter over a Group
V2-0901 · Fix · intermediateIncorrect
Filter Context & CALCULATE
0%
2/5
Percentage over a Hierarchy Subtotal
V2-0902 · Write measure · intermediateFilter Context & CALCULATE
99.25%
5/5
Repair a Minimum over an Arbitrary Selection
V2-0903-A · Fix · intermediateIncorrect
Filter Context & CALCULATE
0%
1/6
Repair a Maximum over an Arbitrary Selection
V2-0903-B · Fix · intermediateIncorrect
Filter Context & CALCULATE
0%
5/6
List the Selected Values
V2-0904 · Fix · basicIncorrect
Table Expressions
0%
0/4
Many-to-Many via Cross-Filter
V2-0905-A · Write measure · intermediateRelationships & Model Semantics
98.45%
4/4
Many-to-Many via the Bridge Table
V2-0905-B · Write measure · basicFilter Context & CALCULATE
98.4%
4/4
Many-to-Many via Summarised Keys
V2-0905-C · Write measure · intermediateIncorrect
Format not followedTable Expressions
0%
0/4
Compute Function
V2-1001-F · Write function · basicFoundations & Scalar Expressions
100%
5/5
Filtered Measure via a Function
V2-1002-C · Write measure · basicFilter Context & CALCULATE
99.85%
4/4
Filtered Compute Function
V2-1002-F · Write function · intermediateIncorrect
Filter Context & CALCULATE
0%
0/6
Weighted Average
V2-1003 · Write measure · basicAggregation
99.1%
4/4
Weighted Average Function
V2-1003-F · Write function · intermediateIncorrect
Aggregation
0%
0/6
Filter Measure by Group of Entities Indirectly Filtered by User Selection (First Period)
V2-1004-A · Write measure · advancedIncorrect
Table Expressions
0%
4/5
Filter Measure by Group of Entities Indirectly Filtered by User Selection (Last Period)
V2-1004-B · Write measure · advancedIncorrect
Table Expressions
0%
5/6
Generic Entity Group Filter Function
V2-1004-F · Write function · advancedIncorrect
Table Expressions
0%
0/6
Generic Entity Group Table Function
V2-1004-G · Write function · advancedIncorrect
Table Expressions
0%
0/6
Monthly Average of a Distinct Count
V2-1101 · Write measure · intermediateIncorrect
Table Expressions
0%
0/5
Measure for the Top N Entities
V2-1102 · Write measure · advancedIncorrect
Ranking & Statistical Analysis
0%
1/6
Calculate for Top Entities Function
V2-1103-F · Write function · advancedIncorrect
Format not followedRanking & Statistical Analysis
0%
0/6
Name of the Top Entity
V2-1104-A · Write measure · intermediateIncorrect
Ranking & Statistical Analysis
0%
0/5
Measure of the Top Entity
V2-1104-B · Write measure · intermediateRanking & Statistical Analysis
99.1%
5/5
Measure of the Other Entities
V2-1104-C · Write measure · advancedIncorrect
Table Expressions
0%
0/5
Top Entity Table Function
V2-1104-F · Write function · intermediateRanking & Statistical Analysis
96.05%
6/6
Measure for Returning Entities
V2-1105 · Write measure · intermediateAnalytical Patterns
98.25%
4/4
Returning Entities Table Function
V2-1105-F · Write function · advancedIncorrect
Analytical Patterns
0%
0/5
Running Total by Attribute
V2-1201 · Write measure · advancedIncorrect
Analytical Patterns
0%
0/5
Growth over the Visible Periods
V2-1202 · Write measure · intermediateIncorrect
Analytical Patterns
0%
3/4
Rank Across the Whole Selection
V2-1203-A · Write measure · intermediateIncorrect
Ranking & Statistical Analysis
0%
2/5
Rank Within a Group
V2-1203-B · Write measure · advancedIncorrect
Ranking & Statistical Analysis
0%
0/5
Percentage of the Best Entity
V2-1204 · Write measure · intermediateIncorrect
Ranking & Statistical Analysis
0%
2/5
Measure of the Top Two Items per Entity
V2-1205 · Write measure · advancedIncorrect
Ranking & Statistical Analysis
0%
0/4
Same Period Last Year
V2-1301-A · Write measure · intermediateTime Intelligence
99.25%
4/4
Growth Against the Same Period Last Year
V2-1301-B · Write measure · basicFoundations & Scalar Expressions
99%
4/4
Year-to-Date Without Future Periods
V2-1302 · Write measure · intermediateIncorrect
Time Intelligence
0%
0/4
Generic Year-over-Year Growth Function
V2-1303 · Write function · advancedIncorrect
Time Intelligence
0%
0/6
Measure to a Comparable Cutoff in Every Year
V2-1304-A · Write measure · advancedIncorrect
Time Intelligence
0%
0/4
Year-over-Year Change of Comparable Periods
V2-1304-B · Write measure · intermediateTime Intelligence
100%
4/4
Moving Average over Months
V2-1306 · Write measure · advancedIncorrect
Time Intelligence
0%
0/4
Numeric Value Shown Only at the Entity Level
V2-1601-A · Write measure · basicIncorrect
Foundations & Scalar Expressions
0%
3/5
Text Value Shown Only at the Entity Level
V2-1601-B · Write measure · basicIncorrect
Foundations & Scalar Expressions
0%
3/5
Aggregation-Aware Measure
V2-1602 · Fix & optimize · intermediateIncorrect
Relationships & Model Semantics
0%
3/6
Average of the Top Periods per Year
V2-1603 · Fix · advancedIncorrect
Table Expressions
0%
1/4
Repair a Distinct Count Broken by a Table Variable
V2-1801 · Fix · advancedIncorrect
Filter Context & CALCULATE
0%
0/4
Repair an Average Share
V2-1802 · Fix · basicRow Context & Context Transition
100%
4/4
Repair a Measure Restricted to Each Entity's First Day
V2-1803 · Fix · advancedIncorrect
Relationships & Model Semantics
0%
0/4
Measure for Items Shared by Most Selected Entities
V2-1901 · Write measure · advancedIncorrect
Table Expressions
0%
2/5
Forecast Corrected by the Observed Error
V2-1902 · Write measure · advancedIncorrect
Analytical Patterns
0%
1/4