What approach does SREed use in designing and implementing its evaluation projects?
Our evaluations follow the Evaluation Standards Published by Joint Committee on Standards for Educational Evaluation (JCSEE). We work to ensure that whatever tools used in an evaluation are the best for addressing the client’s evaluation objectives. In our work “best” is defined as rigorous, valid, reliable, culturally appropriate, actionable and cost-effective.
Each evaluation project we undertake has a variety of relevant approaches undergirding our work. Our overall evaluation approach can range from entirely responsive to preordination, and all shades in between. For responsive evaluation, we work collaboratively with the client and other stakeholders throughout the project to ensure that program and evaluation objectives are well thought out and relevant and that the methods used in the evaluation are collaboratively determined to best address their objectives.
To accomplish this, we maintain a large presence in the program by participating in planning meetings, actively engaging stakeholder groups, and observing and even participating in program activities. Responsive evaluations evolve over time and are best used to provide programs with actionable formative information for improving implementation and program effectiveness.
For preordinate evaluations, we work collaboratively with the client to develop a detailed scope of work, objectives and timeline at the beginning of the evaluation. These evaluations are better used with programs that have already been established in a setting for some time and are already understood well. Thus, they typically are used for summative evaluations. Randomized-control trials are a good example of a preordinate program evaluation. In practice, our evaluations typically have both preordinate and responsive components. Certain aspects of most evaluations can be planned out in advance while others will need to be changed as the evaluation and project is implemented.
Regardless of whether the evaluation methods are responsive or preordinate, the ultimate goal is to empower stakeholders to make informed decisions about programs and policies.
What methods does SREed use when conducting
We have expertise and experience using a wide variety of technologies in our evaluations. For each project, we use some combination of focus groups, interviews, direct observation, logic modeling, surveys, questionnaires, statistical analysis and document analysis to meet the objectives of the evaluation. We also apply various experimental and quasi-experimental approaches to our evaluations including randomized-control trials, regression-discontinuity, and propensity-score matching.