Summer 2021 arrangements
This year, due to the ongoing impact of the coronavirus (COVID-19) pandemic many assessments for vocational and technical qualifications (VTQs) and other general qualifications had to be adapted or did not go ahead. COVID-19 caused different levels of disruption across the country, so many colleges, schools and training providers were not able to teach all the necessary qualification content.
Vocational qualifications are frequently modular and assessment typically happens throughout the course of study. They also tend to have a high proportion of teacher assessment. Some assessments are necessary to confer occupational competence or are ‘Licences to Practice’. This diversity meant that it was not possible to prescribe a single approach to either adaptations or teacher-assessed grades (TAGs).
We asked awarding organisations (AOs) to balance carefully mitigating the effects of COVID-19 with the need to provide fair and reliable results that allowed learners to progress. In many cases, VTQ results have been determined using normal assessment methods. Some learners will have carried forward centre assessment grades (CAGs), from 2020, for some units or components. Some results have been determined through adapted assessments, including remote invigilation. Other results have been decided wholly, or in part, using TAGs like those used for A levels and GCSEs.
TAGs had to be based on evidence of a learner’s achievement. Teachers drew on a range of different types of evidence to inform their professional judgement about a learner’s result. AOs advised on the process teachers and tutors should follow when determining TAGs and how to check that decisions were evidence-based and consistent. Most learners had already completed assessments, many of which had been marked and, in some cases, moderated earlier in the course. Teacher judgements had to be reviewed by other subject teachers and assessors, as well as the relevant head of department or head of centre before TAGs could be submitted to AOs.
Many AOs reviewed centres’ quality assurance procedures upfront, others adapted their normal verification or moderation processes to provide centres with additional support throughout. Some AOs required centres to confirm that they had complied with their internal quality assurance arrangements, while other AOs confirmed this through their monitoring and quality assurance processes.
After TAGs were submitted, AOs conducted their own quality assurance processes. AOs took different approaches to this, depending on their qualifications and the part that TAGs had played in the final result. Some AOs did this through an extension of their normal centre monitoring, some asked centres to provide rationales for any results that looked unusual and also looked at work from centres selected at random, others looked at a sample of learner evidence, and many conducted a combination of these activities.
Results this year have only been possible due to the hard work of everyone involved, not least learners themselves. We have placed trust in the system, and especially in teachers and tutors. They have done everything possible to help learners achieve their qualifications and progress in their education or career.
Learners who think there has been a mistake with their grade can choose to appeal via their school or college; learners who are unhappy with their grade can talk to their centre about taking an assessment instead.
2021 results
This year we have carried out a range of analyses to support our understanding of results.
Outcomes
We primarily focus on the issuing of top grades, rather than the issuing of passing grades, as the percentage pass rate in our dataset is usually close to 100% in all years, as fail grades are often not reported. In every year the cohort of VTQ learners differs quite substantially with regard to their numbers, their ages, their prior attainment, and the centres and centre types they attend. The general ability of cohorts of learners might also have changed over time. The qualifications vary according to factors such as qualification size and types of assessment.
This year we saw an increase in volumes for all Performance Table qualification entries. This was particularly acute for Level 1/2 Performance Table qualifications (from 215,005 in 2019, to 354,855 in 2020, to 393,380 in 2021). Any changes in grade distributions could be explained partly due to the relatively large changes in entry size over time.
Overall, the proportion of Level 2 Passes in Level 1/2 qualifications, remained relatively stable. Those Level 1/2 qualifications with the highest entries showed a decrease in the proportion of top grades being issued (from 11.0% in 2020 to 8.9% in 2021). However, this followed a significant rise in top grades issued between 2019 (2.1%) and 2020 (11.0%).
For Level 2 qualifications the general shape of the grade distributions has not substantially changed. In the largest group of qualifications, the proportion of top grades slightly increased between 2020 and 2021 (from 25.7% to 30.1%).
Equalities
AOs looked at student work from a sample of schools and colleges. They found no evidence that teachers’ judgements were biased in favour of one group of students or another.
We conducted equalities analyses to check whether the gaps between the average results of different groups of students, which are observed in normal years, have changed this summer. We compare the extent to which the relationship between results and student background variables in 2019 and 2020 are similar in the 2021 outcomes. In doing so, we take account of the prior attainment of the students. This included a consideration of gender, ethnicity, free school meal eligibility (FSM), the Income Deprivation Affecting Children Index (IDACI), and special educational needs (SEND).
There are some small changes in the results of some groups of students, which are observed in normal years, which may reflect the impact of COVID-19. The only notable difference identified was that males were on average 2.2% less likely to achieve top grades than females in 2019, but this difference increased to 7.8% in 2020 and reduced slightly to 7.4% in 2021.
Regional results
We conducted analysis to identify if any differences in the attainment of top grades appear to exist across different regions. We found that the degree of change for each region between 2018, 2019, 2020 and 2021 is relatively consistent, accounting for the fact that a degree of variation is always to be expected. The changes occurring in 2021 from previous years for any one region do not seem out of the ordinary, relative to other regions, suggesting a picture of stability across regions.
