Use of Evaluation Rubrics
This presentation is for those of you who are grappling with how to evaluate where the context keeps changing, the activities planned morph into something different, with varying degrees of success, and where you are left with a bit of a gap between what is planned and what actually happens but still need to evaluate it. This presentation shows how rubrics can provide the flexibility, ability to adapt to change and keep the evaluation relevant to context.
This presentation was given by Judy Oakden at the Anzea Conference in Auckland, in July 2013.
Evaluation rubrics offer a transparent process for making explicit the judgments being used in an evaluation and are used to assess the quality, the value or the importance of the programme or service being evaluated. There has been increased use of rubrics over the past few years in a wide range of organisations and situations. This session explored some of the lessons learned to date.
Evaluators in Aotearoa New Zealand are increasingly using rubrics in their evaluative practice. We now have a working knowledge about using rubrics and have some sense of what makes them more or less effective. While rubrics have shifted our evaluation practice, it has not been without challenges. Judy observes “I’d put my money on rubrics being here to stay, but I think we need to understand the challenges of using them and mitigate against the risks.”
In this e-book Judy Oakden and Melissa Weenink explore some of the challenges they have encountered using rubrics in their practice. They also include feedback from a discussion during a practice-based session at the ANZEA Conference in Auckland, New Zealand in 2015 where they explored difficulties they and others face with rubrics.
This article presents a practice example of how evaluators use rubrics to make evaluative judgements. It also details how the use of rubrics supports robust data collection and frames the analysis and reporting. Judy Oakden has written a detailed account of this process as part of the first Better Evaluation writeshop process, led by Irene Guijt.
This is a practice-based article by the Kinnect Group members (Julian King, Kate McKegg, Judy Oakden, Nan Wehipeihana). It shares the Group’s learnings on the use of evaluative rubrics to deal with the challenge of surfacing values and improving the credibility of evaluation. Evaluative rubrics enable values to be dealt with in a more transparent way. In the Group’s experience, when evaluators and evaluation stakeholders get clearer about values, evaluative judgments become more credible and warrantable.