Ticking the Boxes: Quality Validation?
Validation is one of those jobs that we tend to put to the bottom of the pile, especially as the 2015 Standards only require validation once within a 5-year cycle (with 50% of scope validated within 3 years). So why create a lengthy, time-consuming process that nobody has time for?
Well…. if the process is developed in a way that is strategic and organised and provides valuable feedback on improving the assessment and related processes, it can be extremely valuable. While setting the process up initially may be time-consuming, the long-term benefits to be gained are exponential.
When choosing a strategy or technique for validation, there are some key things to consider:
Do you have available staff to manage this process effectively?
Have they been given time to manage this process effectively?
Do they understand the validation process or will they need upskilling?
What is the cost to the organisation? Downtime? Staffing? Outsourcing?
Do you have a plan for this process?
How can technology be used to streamline the process?
You must then decide how the validation outcomes will be documented and how the recommendations will be applied. Options that RTOs may choose include:
A validation template report that is a fillable Word or PDF document;
An online form through Microsoft, Google Forms, or another platform for forms and surveys; or
A review tool that allows for validation actions to be required and evidence uploaded.
When looking at these options, consider:
Is the ticking of boxes (Yes/No) quality feedback on ‘why’ the assessment may not be valid, reliable, flexible or fair?
Wouldn’t it be helpful to include ‘how’ the assessment could be adjusted to address any identified issues?
Most people are happy to know if something is not quite hitting the mark as long as they have guidance on fixing it.
All existing RTOs should have a process for validation as it has been a specific requirement of the Standards since 2015 and is also part of the new 2025 Outcomes Standards. The only significant change to this new process is removing the requirement for 50% validation within the first 3 years and inserting the word ‘regularly’, indicating it does need to be more than once in a 5-year cycle.
There is also an additional requirement in the Revised 2025 Outcomes Standards for RTOs 1.3 b) ‘assessment tools are reviewed prior to use to ensure assessment can be conducted consistent with the principles of assessment and rules of evidence’? [Policy Draft - Outcome Standards]. It is essentially the same thing, but this would be a checking mechanism to ensure assessment tools are fit for purpose and are conducted in line with the principles of assessment and rules of evidence before being administered to learners.
“It is essential to spend the time and effort upfront to create a systematic and organised approach to validation that will provide value to the assessment process.”
A tick ‘n’ flick method might seem the best approach to time-poor trainers/assessors just to get it done, but does it provide enough information to the trainer/assessor to enable them to improve their assessment practices? Does it provide sufficient evidence of continuous improvement? Does it provide feedback to resource developers that their assessment tools are hitting the mark and providing consistent outcomes? Does it make sure that your assessment is best practice?
The diagram at the top of this article provides a graphical representation of a systematic approach to pre and post validation requirements.
What Next?
If you’d like our help in implementing a quality validation system, or you would like us to conduct an independent validation of your assessment tools for a fresh approach, get in touch!
