Main points

1. Evaluation research is a special form of research designed to produce practical information about the effects or outcomes of a program or service.
2. Evaluation differs from other social science research in five ways: (1) it is more likely to be sponsored (paid for); (2) its purpose is to provide information for making decisions about a program rather than for advancing knowledge on some topic; (3) it has greater potential for conflict among persons and groups interested in the results of the evaluation; (4) it is more likely to involve a team of researchers rather than a single researcher; and (5) results are frequently less precise than expected for other social research.
3. The main steps in conducting an evaluation are: (1) establishing a clear agreement with the sponsor of the evaluation regarding the terms and conditions of the evaluation; (2) gaining and maintaining the cooperation of stakeholders; (3) reviewing the literature to learn about similar evaluations; (4) learning as much as possible about the program to be evaluated; (5) preparing the design for the study; (6) collecting the data; (7) analyzing the data and interpreting the results; (8) preparing a draft report, getting feedback from the sponsor and stakeholders, and preparing and submitting the final report.
4. Stakeholders are individuals and groups who have a strong personal interest in the program being evaluated. They include staff of the organization responsible for the program, community leaders, and persons served by the program.
5. Gaining the trust and cooperation of stakeholders is essential for conducting a successful evaluation. On the positive side, stakeholders can provide vital data and check the validity of the evaluator's observations, findings, interpretation, and conclusions. On the negative side, if suspicious of the evaluator and the evaluation process, they can greatly limit or even destroy an evaluation.
6. Preparing a design for an evaluation includes: (1) identifying or developing the objectives for the program being evaluated; which identify the expected outcomes for the program; (2) developing a design appropriate for measuring the outcome variables; and (3) selecting or developing indicators for measuring the outcome variables.
7. Evaluation designs may be based on quantitative or qualitative research methods. Quantitative methods, such as use of available data or surveys, give more precise results. Qualitative methods are better for understanding how stakeholders and participants view a program, for understanding how a program operates in real life, and for measuring more complex variables. When possible, both approaches should be used.
8. Evaluation reports should be brief and written in plain language without extensive use of social science concepts. The sponsor and stakeholders should be given an opportunity to review a draft version of the report. Their comments can help improve the accuracy of observations and provide a validity check on findings and conclusions.
9. Evaluators should adhere to the highest standards of professional and ethical behavior.

PREV       NEXT     BEGINNING     TOC

---