The Scorecard Accountability Score is an automatically calculated feedback score that provides insight into how effectively a scorecard is being used.
Accountability Score Overview
The Scorecard Accountability Score is a two part feedback system that gives users an at-a-glance insight into how effectively a Scorecard is being used based on the Results-Based Accountability methodology. It displays two separate scores that give managers insight into their data. To access the Accountability Score, select the score buttons in the Scorecard heading. If they do not display you will need to enable the Accountability Score for the Scorecard using the steps at the end of this article.
What It Is Not
The Scorecard Accountability Score is not a replacement for a professional opinion on the strategy or actual content of a specific Scorecard. It does not take into account the quality of the writing or research that goes into crafting the Turn the Curve strategy for each measure and it also does not take into account the potential impact of the Story Behind the Curve for each measure which may make it's trend/baseline analysis inaccurate. It should be used merely as a quick guidance tool for performance managers to hone in on neglected or under-performing Scorecards.
The Engagement Score
The Engagement score gives an index between 1 and 100 of how complete and up-to-date the information on a scorecard are. The Engagement Score is entirely determined using information entered into Indicators or Performance Measures (collectively called "measures"). The factors taken into consideration when determining the Engagement Score are:
- Notes Filled Out - The number of measure notes that have been filled out.
- Notes Up-To-Date - The number of measure notes that have been updated since the last actual value was entered.
- Measure Forecast Values - The number of measures that have a forecast value into the future.
- Actual Values Up-To-Date - Number of measures that have an up-to-date actual value. An up-to-date value is defined as an Actual Value exists for this measure for the previous time period from today's date. For example, if it is December 15, 2019 today then a data value would have to exist for these time periods to be considered up to date:
- Annual: 2018
- Half-Year: H1 2019
- Quarter: Q3 2019
- Month: November 2019
How the Engagement Score is Calculated
The engagement score is a weighted average of the completed items listed above. Weights are determined based on the relative importance of completing that task based on the Results-Based Methodology. The weights are distributed as follows:
- 47% - Notes Filled Out
- 27% - Notes Up-To-Date
- 13% - Measure Forecast Values
- 13% - Actual Values Up-To-Date
Quick Tips to Improve Your Engagement Score
- Complete the Turn the Curve plan for each measure
- Considering removing unused note fields
- Add a forecast to each measure
- Get your data values up to date
The Impact Score
The Impact score gives an index between 1 and 100 of how well a Scorecard's measures are trending and performing. The Impact Score is determined by taking into account the current trend direction and actual vs. baseline performance of the Indicators and Performance Measures (collectively called "measures") on a Scorecard. The factors taken into consideration when determining Impact Score are:
- Trending Positively - The number of measures in which the current actual value is better than the previous actual value.
- No Change - The number of measures in which the current actual value is the same as the previous actual value.
- Better than Baseline - The number of measures in which the current actual value is better than the baseline actual value.
- No Change from Baseline - The number of measures in which the current actual value is the same as the baseline actual value.
Note - the baseline value for each measure is by default the oldest actual value entered into a measure. Users can manually set a baseline value for each measure by selecting the radio button for baseline for a time period whenever entering data values for that measure.
How the Impact Score is Calculated
The Impact Score is a weighted average of measures matching the properties listed above. Weights are determined based on the relative importance of the measure's achievement and provided only as a quick insight for managers to compare Scorecards. The weights are distributed as follows:
- 60% - The ratio of measures that have a positive trend or no trend vs the total number of measures
- 40% - The ratio of measures that have beaten the baseline or have no change from the baseline vs the total number of measures
Turning the Scorecard Accountability Scoring On/Off
The Scorecard Accountability Score is controlled at a Scorecard level. This means that you can adjust whether it displays on each and every Scorecard. To enable or disable the Scorecard Accountability Score follow these steps:
- Navigate to the Scorecard you wish to modify
- Select Edit in the top right corner
- In the general section at the top of the page, toggle the Enable Accountability Score option on or off
- Select Save