Archive
We are proud of the way we constantly develop new ideas, collaborate generatively with others, in writing and developing conference presentations.
We also aim to produce work of a publishable standard that is available on client websites. These days, most of our work is published. All evaluation reports listed here were either published by the client first or we have permission to publish them.
Published research and evaluation reports
This list of reports only includes those which have been made publicly available.
Oakden, J. & Spee, K. (2023). Creatives in Schools Programme Evaluation Report: Round 3 2022. Wellington: Te Tāhuhu o te Mātauranga – Ministry of Education.
Spee, K. & Oakden, J. (2023). Inspiring community action: Thriving Southland provides extension to farmers and the Southland community. Wellington New Zealand, Pragmatica Limited.
Oakden, J & Spee, K. (2022). Talanoa Ako: Response to COVID-19 case studies. Wellington, New Zealand: Te Tāhuhu o te Mātauranga – Ministry of Education.
Oakden, J. & Spee, K. (2022). Creatives in Schools Programme Evaluation Report: Round 2 2021. Wellington: Te Tāhuhu o te Mātauranga –the Ministry of Education.
Oakden, J. & Spee, K. (2022). Reading Together® Te Pānui Ngātahi: Summary of evaluations and implementation exemplars. Iterative Best Evidence Synthesis (BES) Hei Kete Raukura report. Wellington: Pragmatica Limited.
Spee, K. & Oakden, J. (2022). The difference that makes a difference: Thriving Southland supports good farming practice through Catchment Groups. Wellington New Zealand, Pragmatica Limited.
Wehipeihana, N., Sebire, K., Spee, K. & Oakden, J. (2022). In pursuit of Māori health equity. Evaluation of the Māori Influenza and Measles Vaccination Programme. Wellington: Ministry of Health.
Oakden, J. (2021). Evaluation of Reading Together® Te Pānui Ngātahi 2020 Case Study: Benefits of programme delivery in Samoan churches. Wellington: Te Tāhuhu o te Mātauranga | Ministry of Education.
Oakden, J. & Spee, K. (2021). Creatives in Schools Programme Evaluation Report: Round 1 November 2020. Wellington: Ministry of Education
Spee, K. & Oakden, J. (2021). Showcasing Pacific Performing Arts in Marlborough – a community response. Wellington: Ministry of Education.
Spee, K. & Oakden, J. (2021). Student-led choreography – to build student confidence and creative thinking. Wellington: Ministry of Education.
Wehipeihana, N., Sebire, K. W., Spee, K. & Oakden, J. (2020). More than just a jab: Evaluation of the Māori influenza vaccination programme as part of the COVID-19 Māori health response. Wellington: Ministry of Health.
Spee, K., & Oakden, J. (2019). Envirolink Evaluation Report 2019. Wellington, New Zealand: Pragmatica Limited.
Oakden, J., Spee, K., Moss, M., Pipi, K., Smith, R., & King, J. (2017). Evaluation of the Regional Growth Programme: Implementation and ways of working. Wellington, New Zealand: Pragmatica Limited.
Oakden, J., Toumu’a, R., Sauni, P., & Spee, K. (2016). Evidence-based decision making for Pasifika success in mathematics: an exemplar. Wellington, New Zealand: Ministry of Education.
Toumu’a, R., Oakden, J., & Sauni, P. (2016). Leadership practices supporting Pasifika student success: McAuley High School case study. Wellington, New Zealand: Ministry of Education.
Spee, J., Oakden, J., Toumu’a, R., & Tuagalu, C. (2016). A model of academic mentoring to support Pasifika achievement: an exemplar. Wellington, New Zealand: Ministry of Education.
Spee, K., Toumu’a, R., Oakden, J., Sauni, P., & Tuagalu, C. (2016). Leadership practices supporting Pasifika student success: Otahuhu College case study. Wellington, New Zealand: Ministry of Education.
Spee, K., Oakden, J., Toumu’a, R., Sauni, P., & Tuagalu, C. (2016). Teacher coaching to upskill teachers and support Pasifika student achievement: an exemplar. Wellington, New Zealand: Ministry of Education.
Spee, K., Oakden, J., Toumu’a, R., Sauni, P., & Tuagalu, C. (2016). Leadership practices supporting Pasifika student success: De La Salle College case study. Wellington, New Zealand: Ministry of Education.
Oakden, J., & Wehipeihana, N. (2014). Māori Agribusiness Prototype projects: Final evaluation executive summary prepared for Ministry for Primary Industries. Wellington, New Zealand: Kinnect Group.
Oakden, J., & Wehipeihana, N. (2014). Māori Agribusiness Prototype projects: Final evaluation main report prepared for Ministry for Primary Industries. Wellington, New Zealand: Kinnect Group.
Oakden, J., King, J., & Allen, W. (2014). Evaluation of the Sustainable Farming Fund: Executive summary, prepared for Ministry for Primary Industries. Wellington, New Zealand: Kinnect Group.
Oakden, J., King, J., & Allen, W. (2014). Evaluation of the Sustainable Farming Fund: Main report, prepared for Ministry for Primary Industries. Wellington, New Zealand: Kinnect Group.
Allen, W., King, J., & Oakden, J. (2014). Three case studies: a companion document to the Evaluation of the Sustainable Farming Fund, prepared for Ministry for Primary Industries. Wellington, New Zealand: Kinnect Group.
Norman, R., & Oakden, J. (2014). Wellington’s knowledge economy – coming to grips with technology change. Wellington, New Zealand: Victoria University of Wellington.
Oakden, J., & McKegg, K. (2011, August). Waste Minimisation Act implementation: Evaluation of stakeholder perspectives. Wellington, New Zealand: Ministry for the Environment.
Oakden, J., & McKegg, K. (2011). Journeys of clinicians who embrace peer workers in their practice. Wellington, New Zealand: Wellink Trust.
Wehipeihana, N., Oakden, J., Spee, K., Cram, F., Pipi, K., & Porima, L. (2011). Evaluation of the Māori Oral Health Providers project. Wellington, New Zealand: Ministry of Health .
Oakden, J., Pipi, K., Spee, K., & Wehipeihana, N. (2010). Rangiātea: Western Springs College case study. Wellington, New Zealand: Ministry of Education.
Oakden, J., Pipi, K., Spee, K., & Wehipeihana, N. (2010). Rangiātea: Western Springs College exemplar. Wellington, New Zealand: Ministry of Education.
Oakden, J., Pipi, K., Spee, K., & Wehipeihana, N. (2010). Rangiātea: Kakapo* College case study. Wellington, New Zealand: Ministry of Education.
Oakden, J., Pipi, K., Spee, K., & Wehipeihana, N. (2010). Rangiātea: Kakapo* College: exemplar. Wellington, New Zealand: Ministry of Education.
Spee, K., Oakden, J., Wehipeihana, N., & Pipi, K. (2010). Rangiātea: Hamilton Girl’s High School case study. Wellington, New Zealand: Ministry of Education.
Spee, K., Oakden, J., Wehipeihana, N., & Pipi, K. (2010). Rangiātea: Hamilton Girl’s High School exemplar. Wellington, New Zealand: Ministry of Education.
Spee, K., Oakden, J., Wehipeihana, N., & Pipi, K. (2010). Rangiātea: Opotiki College case study. Wellington, New Zealand: Ministry of Education.
Spee, K., Oakden, J., Wehipeihana, N., & Pipi, K. (2010). Rangiātea: Opotiki College exemplar. Wellington, New Zealand: Ministry of Education.
Wehipeihana, N., & Oakden, J. (2010). Rangiātea: Hastings Boy’s High School case study. Wellington, New Zealand: Ministry of Education.
Wehipeihana, N., & Oakden, J. (2010). Rangiātea: Hastings Boy’s High School exemplar. Wellington, New Zealand: Ministry of Education.
McKegg, K., & Oakden, J. (2009). Characteristics of good peer support. Wellington, New Zealand: Wellink Trust.
Peer-reviewed articles and publications
Oakden, J., Walton, M., & Foote, J. (2021) Contracting public health and social services: insights from complexity theory for Aotearoa New Zealand, Kōtuitui: New Zealand Journal of Social Sciences Online, 16:1, 180-195, DOI: 10.1080/1177083X.2020.1822422
Oakden, J., & King, J. (2018). Evaluation. In M. Tolich & C. Davidson (Eds.), Social science research in New Zealand: An introduction (3rd ed., pp. 180–193). Auckland, New Zealand: Auckland University Press.
Eoyang, G., & Oakden, J. (2016). Adaptive evaluation: Synergy between complexity theory and evaluation practice. Emergence: Complexity and Organization, 18(3–4). doi:10.emerg/10.17357.e5389f5715a734817dfbeaf25ab335e5.
Oakden, J. (2013). Evaluation rubrics: how to ensure transparency and clear assessment that respects diverse lines of evidence. BetterEvaluation: Melbourne, Australia. Retrieved from http://betterevaluation.org/
King, J., McKegg, K., Oakden, J., & Wehipeihana, N. (2013). Evaluative rubrics: a method for surfacing values and improving the credibility of evaluation, Journal of Multidisciplinary Evaluation, 9(21), 11–20.
Conference Presentations
Oakden, J. (2022) Contracting out for fairer services in complexity: implications for evaluators. Presented at Aotearoa New Zealand Evaluation Association (ANZEA) Conference, Wellington New Zealand, 12 October 2022.
Oakden, J. & Elliot J, (2022) Mind the innovation gap: the unfortunate tale of great programme design let down by traditional commissioning and contracting methods, and what this means for evaluators. Presented at Australian Evaluation Society (AES) Conference, Adelaide, Australia, September 2022.
Wehipeihana, N., Oakden, J & Sebire, K.: (2022) Rapid Insight Cycles: Generating usable insights ‘on-the-run’ for equity focused decision-making at policy and operational levels. Presented at Australian Evaluation Society (AES) Conference, Adelaide, Australia, September 2022.
Oakden, J. (2021) ‘Contracting out for more equitable public health and social services drawing on a complexity-informed view – implications for evaluation’. Presented at Aotearoa New Zealand Evaluation Association (ANZEA) Online Conference, 23 March 2021.
Field, A., McKegg, K., King, J., Oakden, J. & Wehipeihana N. (2021) ‘Pivots and possibilities: Evaluation innovations in 2021’. Presented at Aotearoa New Zealand Evaluation Association (ANZEA) Online Conference, 23 March 2021.
Elliott, J., Oakden, J. & Garner, S. (2020) ‘Agile connections at FestEVAL’. Presented at Australian Evaluation Society (AES) Online FestEVAL 21 September 2020.
Eoyang, G & Oakden, J. (2019) ‘Evaluating in uncertainty: The curse of the wicked problem’. Presented at the American Evaluation Association (AEA) Conference, November 2019, Minneapolis, MN.
Eoyang, G., Morris, W., Oakden, J., Holladay, Anderson, T., Mennin, S. & Webster, C. (2019) ‘I wasn’t expecting THAT! Imagining future scenarios – and the implications for evaluation’.Presented at the American Evaluation Association (AEA) Conference, November 2019, Minneapolis, MN.
Oakden, J. (2018). ‘Applying complexity theory to contracting out…the journey so far’. Presented at the UK Operations Research Conference, 13 September 2018, Lancaster, United Kingdom.
Eoyang, G., & Oakden, J (2018). ‘Making sense of the mess’. Online workshop presented in New Zealand through the Human Systems Dynamics Institute. 23-26 October 2018.
Eoyang, G., & Oakden, J. (2018). ‘Dealing with complex change in evaluation: Let’s have a paradigm change’. Workshop presented at Aotearoa New Zealand Evaluation Association (ANZEA) Conference, 16 July 2018, Auckland, New Zealand
Wehipeihana, N., Oakden, J., King, J., McKegg, K. (2018). ‘Rubrics: transforming evaluation practice, enabling evaluation for change’. Presented at Aotearoa New Zealand Evaluation Association (ANZEA) Conference, 17 July 2018, Auckland, New Zealand
Eoyang, G., Oakden, J., & Fogel, K. (2017). ‘Adaptive evaluation: Theory and practice’. Presented at the American Evaluation Association (AEA) Conference, 10 November 2017, Washington, DC.
Noga, J., Moore, M., & Oakden, J. (2017). ‘Putting the fun and useful back into systems approaches in evaluation practice’. Presented at the American Evaluation Association (AEA) Conference, 10 November 2017, Washington, DC.
Oakden, J., McKegg, K., Wehipeihana, N., King, & J., Davidson, J. (2017). ‘Evaluative rubrics: Delivering well-reasoned answers to real evaluation questions’. Presented at the Canadian Evaluation Society Conference, 3 May 2017, Vancouver, Canada.
Oakden, J. (2016). ‘Evaluating in complexity: what have we learned about designing and running evaluations?’ Presented at the American Evaluation Association (AEA) Conference, 28 September 2016, Atlanta, GA.
Oakden, J. (2016). ‘Evaluating in complexity: nearly 20 years on, what have we learned?’ Presented at the European Evaluation Association (EES) Conference, 2 September 2016, Maastricht, Netherlands.
Guijt, I., & Oakden, J. ‘Collective sensemaking: How to plan yours to great effect.’ Presented at the European Evaluation Association (EES) Conference, 2 September 2016, Maastricht, Netherlands.
Oakden, J. (2016). ‘Evaluating in complexity: nearly 20 years on, what have we learned?’ Presented at the Aotearoa New Zealand Evaluation Association (ANZEA) Conference, 19 July 2016, Wellington, New Zealand.
McKegg, K., Oakden, J., & Mardon, H. (2016). ‘New ways of working collaboratively with data – the Enviroshcools data journey.’ Presented at the Aotearoa New Zealand Evaluation Association (ANZEA) Conference, 20 July 2016, Wellington, New Zealand.
McKegg, K., Oakden, J., Henry, J., & Goodwin, D. (2016). ‘Evaluating collaboration a year on: Helping an innovative policy process to stay on track.’ Presented at the Aotearoa New Zealand Evaluation Association (ANZEA) Conference, 20 July 2016, Wellington, New Zealand.
Oakden, J., & Eoyang, G. (2015). ‘Evaluation rubrics look easy but can be hard to do well: lessons from the field.’ Presented at the American Evaluation Association Conference, 13 November 2015, Chicago, IL.
Guijt, I., Oakden, J., & McKegg, K. (2015). ‘So now you have got the data, what’s next? Collaborative sensemaking to navigate diversity.’ Presented at the Australasian Evaluation Society (AES) Conference, 8 September 2015, Melbourne, Australia.
McKegg, K., & Oakden, J. (2015). ‘Developmental evaluation.’ A full-day pre-conference workshop in Melbourne and a post-conference workshop in Canberra, Australia. Presented at the Australasian Evaluation Society (AES) Conference, September 2015.
McKegg, K., Oakden, J., & Twyford, V. (2015). ‘Reaching across boundaries – evaluation of high stakes collaboration.’ Presented at the Australasian Evaluation Society (AES) conference, 8 September 2015, Melbourne, Australia.
Oakden, J. (2015). ‘A new compass for dealing with complexity when we are all at sea.’ Presented at the Aotearoa New Zealand Evaluation Association (ANZEA) Conference, 7 July 2015, Auckland, New Zealand.
Oakden, J., & Weenink, M. (2015). ‘What’s on the rubric horizon: Taking stock of our current practice and thinking about what is next.’ Presented at the Aotearoa New Zealand Evaluation Association (ANZEA) Conference, 7 July 2015, Auckland, New Zealand.
McKegg, K., Oakden, J., Goodwin, D., & Henry, J. (2015). ‘Reaching across boundaries – evaluation of high stakes collaboration.’ Presented at the Aotearoa New Zealand Evaluation Association (ANZEA) Conference 7 July 2015, Auckland, New Zealand.
Oakden, J. (2015). ‘Rich pictures in evaluation.’ Presented as a webinar for the American Evaluation Association Coffee Break Series 16 April 2015.
Oakden, J. (2015). ‘Rich pictures in evaluation.’ Presented as a webinar for 2015 Webinar Series: Practical Application of Systems to conduct evaluation – cases and examples – hosted by University of Colorado Denver, CO, 8 April 2015.
Oakden, J. (2014). ‘If a picture paints a thousand words – the use of rich pictures in evaluation.’ Presented at the American Evaluation Association Conference, 2 October 2014, Denver, CO.
Bates, A., & Oakden, J. (2014). ‘Building an evaluation system to assess the effectiveness of the Like Minds, Like Mine anti-discrimination training nationwide.’ Presented at the Aotearoa New Zealand Evaluation Association (ANZEA) Conference, July 2014, Wellington, New Zealand.
Bear, C., & Oakden, J. (2014). ‘It ain’t just what you do – it’s also the way you do it: evaluation that delivers maximum impact and influence.’ Presented at the Aotearoa New Zealand Evaluation Association (ANZEA) Conference, July 2014, Wellington, New Zealand.
Jane, D., & Oakden, J. (2013). ‘What gets measured gets done: Evaluation as a tool for advocacy.’ Presented at Alternatives 2013 Conference 4–8 December 2013, Austin, TX.
Oakden, J. (2013). ‘Evaluation rubrics – passing fad or an important contribution to evaluation practise?’ Presented at the Aotearoa New Zealand Evaluation Association (ANZEA) Conference, July 2013, Auckland, New Zealand.
Wehipeihana, N., & Oakden, J. (2013). ‘Costing evaluation projects – an art, not a science.’ Presented as a pre-conference half-day workshop at the Aotearoa New Zealand Evaluation Association (ANZEA) Conference, July 2013, Auckland, New Zealand.
Cram, F., & Oakden, J. (2012). ‘Quizzing purposeful relationships: what is this thing called a ‘working relationship?’ presented at the Australasian Evaluation Society (AES) Conference, 29 August 2012, Adelaide, Australia.
Mutch, C., Oakden, J., & Maw, N. (2012). ‘Complementary evaluation: Bringing theory and practice together through relationships and capacity building.’ Presented at the Aotearoa New Zealand Evaluation Association (ANZEA) Conference, July 2012, Hamilton, New Zealand.
McKegg, K., Oakden, J., & Boyce W. (2012). ‘Tackling wicked problems: Evaluative processes that go to the heart of the inter-relationships, perspectives and boundaries that influence the outcomes of complex innovations.’ Presented at the Aotearoa New Zealand Evaluation Association (ANZEA) Conference, July 2012, Hamilton, New Zealand.
Oakden, J., & Spee, K. (2011). ‘Heralding a new dawn in Māori student achievement: Illuminating leadership, school systems, and what works to raise Māori student achievement.’ Presented at NZARE Conference & Annual Meeting 2011, 1 December 2011, Tauranga, New Zealand.
Oakden, J., & Bear, C. (2011). ‘Managing complexity in evaluation.’ Presented at the Aotearoa New Zealand Evaluation Association (ANZEA) Conference, 8–10 August, 2011, Wellington, New Zealand.
Oakden, J. (2011). ‘Working with rubrics.’ Presented at Te Puni Kōkiri, 30 June 2011, Wellington, New Zealand.
Oakden, J. (2010). ‘Encouraging behaviour change.’ Presented to Environment Waikato staff, 13 December 2010, Hamilton, New Zealand.
Oakden, J. (2010). ‘The use of soft systems methodology and complex adaptive systems concepts in evaluability assessment.’ Presented at the Australasian Evaluation Society (AES) Conference, 3 September 2010, Wellington, New Zealand.
Wehipeihana, N., & Oakden, J. (2009). ‘Securing whānau engagement – Lessons learned from the Rotorua trial of the Reading Together programme.’ Presented to school representatives in the Manurewa Literacy Project, 24 November, Manurewa Marae, Auckland, New Zealand.
Wehipeihana, N., Oakden, J., McKegg, K., and Pipi, K. (2009). ‘Māori working with non-Māori.’ Presented at the Aotearoa New Zealand Evaluation Association (ANZEA) Conference, 13–16 July 2009, Rotorua, New Zealand.
McKegg, K., Wehipeihana, N., & Oakden, J. (2008). ‘How good is good enough? Says who?’ Presented at the Aotearoa New Zealand Evaluation Association (ANZEA) Conference, 13–16 July 2008, Rotorua, New Zealand.
Wehipeihana, N., & Oakden, J. (2008). ‘Costing evaluation projects: An art, not a science’. Presented as a pre-conference half-day workshop at the Aotearoa New Zealand Evaluation Association (ANZEA) Conference, 13 July 2008, Rotorua, New Zealand.
Oakden, J., & Cormack, R. (2007). ‘Plotting a path for Kiwis being Sorted’. Presented at The Social Marketing Downunder Conference, 8–9 March 2007, Wellington, New Zealand.
Stockwell, W., & Oakden, J. (2005). ‘Knowledge – how much does it matter?’ Presented at The Social Marketing Downunder Conference 10–11 March 2005, Wellington, New Zealand.