Automated Essay Scoring Trial(s)
Tender ID: 447256
Tender Details
Tender Description
NZQA is looking to identify, and take up, the new assessment opportunities offered by digitally enabled teaching and learning which may result in further research, innovation trials, pilots or enhancements to NCEA Online. In 2020 we trialled automated essay scoring (AES) to test whether it could support NCEA marking. We are now interested in further exploring how AES can be used to support NCEA with additional vendors of AES solutions.
NZQA wants to explore AES solutions to establish:
• how suitable the automated scoring of essay questions is to the NCEA context.
• broaden our understanding of the indicative effort required to establish an automated marking capability, including the skills, lead-time, and appropriate numbers of scripts to “teach the machine learning”.
• increase our knowledge about potential opportunities where existing scoring processes can be supplemented by automated essay scoring technologies.
• explore, when scripts have been marked, what the sources of difference between human and automated marking could be and how automated marking could contribute to the overall quality assurance of marking.
• understand the number of responses that are required to achieve an acceptance level of accuracy.
• explore how automated essay scoring effects the time required to score, and quality assure marking of NCEA examinations.
Location
