Validating an evaluation school functionality tool

African Evaluation Journal

Field Value
Title Validating an evaluation school functionality tool
Creator Roper, Margaret Taimo, Leticia Bisgard, Jennifer L. Tjasink, Katharine
Subject Education; Evaluation School; Functionality; Tool; Validation; Lessons
Description Background: Evaluators are cognisant of the need to determine the effects of an intervention within its context.Objectives: In education evaluations, there was a gap in context-specific assessment tools to determine the status of school functionality with the ultimate aim of examining whether there is a relationship between school functionality context and teaching and learning outcomes. To meet evaluation standards, evaluators must ensure that evaluation tools and data are accurately measuring the indicators and variables. The focus of the article is on lessons learned from a tool validation process. These are shared to guide evaluators in similar settings.Method: Khulisa Management Services (Khulisa) has conducted research and evaluations in South African schools since 1993. In 2011, Khulisa developed a school functionality tool based on local and international literature, engagement with key stakeholders, and through a series of implementation phases over various evaluations. The tool identifies high functional, functional, stagnant but functional and dysfunctional schools. The authors of this article undertook a reflection process to evaluate the evidence gathered to support the meaningfulness, usefulness and appropriateness of the tool properties.Results: Lessons from the validation process include the need to build time and resources for validation from the beginning, validating a tool over time and across evaluations adds value, training of data collectors is critical, and analysis is important towards establishing the consistency and reliability of a tool.Conclusion: While reliability analysis and the validation process are ongoing, preliminary results show that the tool has potential to document context appropriately.
Publisher AOSIS
Date 2020-05-12
Type info:eu-repo/semantics/article info:eu-repo/semantics/publishedVersion — Experiential reflection; Literature review
Format text/html application/epub+zip text/xml application/pdf
Identifier 10.4102/aej.v8i1.423
Source African Evaluation Journal; Vol 8, No 1 (2020); 16 pages 2306-5133 2310-4988
Language eng
Coverage South Africa Current Schools
Rights Copyright (c) 2020 Margaret Roper, Leticia Taimo, Jennifer L. Bisgard, Katharine Tjasink