Using scoring as part of our assessments will help us to be consistent in reaching a judgement on how a local authority is delivering its adult social care responsibilities.
We will follow these stages:
- Review evidence within the evidence categories we’re assessing for each quality statement.
- Apply a score to each of these evidence categories.
- Combine the evidence category scores to give a score for each related quality statement.
- Combine the quality statement scores to give an overall score and rating for a local authority.
We use these scores:
4 = Evidence shows an exceptional standard
3 = Evidence shows a good standard
2 = Evidence shows some shortfalls
1 = Evidence shows significant shortfalls
How we calculate quality statement scores
When we combine evidence category scores to produce a quality statement score, we calculate this as a percentage.
To do this, we divide the total of the evidence category scores by the maximum possible score. This maximum score is the number of relevant evidence categories multiplied by the highest score for each category, which is 4. This gives a percentage score for the quality statement.
We then convert this percentage back to a score for the quality statement, using these thresholds:
25 to 38% = 1
39 to 62% = 2
63 to 87% = 3
over 87% = 4
This makes it easier to understand and combine with the other quality statement scores to calculate the overall rating.
Note: We do not publish the percentage scores or evidence category scores in the final assessment report.
How we calculate the overall rating
We combine the scores for all the quality statements assessed to give an overall score as a percentage. This then provides an overall rating for the local authority’s adult social care provision using these thresholds:
25 to 38% = inadequate
39 to 62% = requires improvement
63 to 87% = good
88% and above = outstanding
The overall percentage score will indicate a more detailed position within the rating scale. This will help us to see if performance is moving up or down within a rating.
For example, for a rating of good, the score will tell us if this is either:
- in the upper threshold, nearing outstanding
- in the lower threshold, nearer to requires improvement.
Similarly, for a rating of requires improvement, the score would tell us if it was either:
- in the upper threshold, nearing good
- in the lower threshold, nearer to inadequate.
Example ratings
| Quality statement | Score |
|---|---|
| Assessing needs | 3 |
| Supporting people to live healthier lives | 4 |
| Equity in experience and outcomes | 2 |
| Care provision, integration and continuity | 2 |
| Partnerships and communities | 2 |
| Safe pathways, systems and transitions | 2 |
| Safeguarding | 3 |
| Governance, management and sustainability | 3 |
| Learning, improvement and innovation | 3 |
| Total score | 24 |
24/36 (maximum score) = 66%
This is in the lower threshold of a rating of good.
By using the following approach, we can make sure any areas of poor quality are not hidden:
- If one or more quality statements have a score of 2, there cannot be an overall rating of outstanding.
- If one or more quality statements have a score of 1, there cannot be an overall rating of either good or outstanding.
How we use data to make our judgements
Data is only one part of the evidence we use to form our judgements, as we consider all the other information gathered during the assessment.
Our assessment reports only include the evidence that is needed to provide the context and to underpin our judgements. They do not include every data or evidence item.
To inform our judgements, we will use metrics and look at specific types of data under some quality statements. These indicators have been thoroughly reviewed and are appropriate for this purpose.
See metrics for local authority assessment framework for a full list of indicators.
Our assessment team will answer specific queries during the assessment.
Quality assuring our judgements and reports
Each draft assessment report goes through a robust quality assurance process. This includes a review by a calibration panel. These panels review and validate the scores and ratings from the assessments to make sure they provide a reliable and consistent view of quality across local authorities.
The panel will include representatives from external organisations as well as CQC colleagues.
Each calibration panel typically looks at 3 to 4 reports, which are moderated against all previous reports. We have a single detailed record of the individual scores for every local authority, which is available to the standing members of the panel to use as a reference tool.