Impact evaluation

Impact evaluation

Impact evaluation assesses the changes in the well-being of individuals that can be attributed to a particular intervention, such as a project, program or policy. [ [http://web.worldbank.org/WBSITE/EXTERNAL/TOPICS/EXTPOVERTY/EXTISPMA/0,,menuPK:384336~pagePK:149018~piPK:149093~theSitePK:384329,00.html World Bank Poverty Group on Impact Evaluation] , accessed on January 6, 2008 ] This type of evaluation has received increasing attention in recent years. It is an important component of the armory of evaluation tools and approaches, albeit only one among a number.

Impact evaluation is more rigorous than many other types of evaluations, since it tries to establish a counterfactual ("What would the situation have been if the intervention had not taken place?"). This involves the collection of baseline data for both an intervention group and a comparison group, as well as a second round of data collection after the intervention, which can be years later. Ideally the comparison group is selected randomly (in which case it is called a control group), and it is isolated from any interventions similar to the original intervention, in order to generate an experimental design and to avoid selection bias. Random selection and isolation from interventions are seldom practicable and at least the latter is also ethically difficult to defend. Nevertheless, there exist impact evaluation designs without random selection that avoid the above-mentioned problems. Impact evaluation is particularly difficult for infrastructure projects, where random selection is more difficult and more time passes until impacts can be observed compared to interventions such as conditional cash transfers.

Evaluation designs

Evaluation designs are determined by the choice of methods used to identify the counterfactual and can be broadly classified into three categories that vary in feasibility, cost, and degree of selection bias:
*Experimental design
*Quasi-experimental design
*Non-experimental design

Estimation methods

Estimation methods broadly follow evaluation designs. Different designs require different estimation methods to measure the welfare of the counterfactual. The four categories of estimation methods are:
*Comparison of means
*Multi-variate regression
*Instrumental variables methods
*Double difference or difference-in-difference

Other definitions of impact evaluation

Impact evaluation is defined differently by different professionals, although some consensus has emerged around the definition quoted above.

Similar definitions

According to the US Environmental Protection Agency impact evaluation is a form of evaluation that assesses the net effect of a program by comparing program outcomes with an estimate of what would have happened in the absence of a program. [ [http://www.epa.gov/evaluate/glossary/i-esd.htm US Environmental Protection Agency Program Evaluation Glossary] , accessed on January 6, 2008 ]

According to the World Bank's Independent Evaluation Group (IEG), impact evaluation is the systematic identification of the effects positive or negative, intended or not on individual households, institutions, and the environment caused by a given development activity such as a program or project. [ [http://www.worldbank.org/ieg/ie/ World Bank Independent Evaluation Group] , accessed on January 6, 2008 ]

Different definitions

A less rigorous definition than the two previous definitions can be found on Evaluationwiki.org, where impact evaluation is simply defined as an evaluation that looks beyond the immediate results of policies, instruction, or services to identify longer-term as well as unintended program effects. [ [http://www.evaluationwiki.org/index.php/Evaluation_Definition:_What_is_Evaluation%3F#Impact_Evaluations Evaluation Definition: What is Evaluation? - EvaluationWiki ] ]

Examples of impact evaluations

The IEG of the World Bank has systematically assessed and summarized the experience of ten impact evaluation of development programs in various sectors carried out over the past 20 years. [ [http://lnweb18.worldbank.org/oed/oeddoclib.nsf/DocUNIDViewForJavaSearch/35BC420995BF58F8852571E00068C6BD/$file/impact_evaluation.pdf Impact Evaluation: The Experience of the Independent Evaluation Group of the World Bank, 2006] ]

An example of a well-known recent impact evaluation is the evaluation of the Conditional Cash Transfer program PROGRESA (now called Oportunidades) in Mexico on development outcomes, in particular schooling, immunization rates and child work.

Sources and external links

* [http://web.worldbank.org/WBSITE/EXTERNAL/TOPICS/EXTPOVERTY/EXTISPMA/0,,menuPK:384336~pagePK:149018~piPK:149093~theSitePK:384329,00.html World Bank Poverty Group World Bank Poverty Group]
* [http://www.worldbank.org/ieg/ie/ World Bank Independent Evaluation Group] * Baker, Judy. 2000. [http://web.worldbank.org/WBSITE/EXTERNAL/TOPICS/EXTPOVERTY/EXTISPMA/0,,contentMDK:20194198~menuPK:451260~pagePK:148956~piPK:216618~theSitePK:384329,00.html Evaluating the Impact of Development Projects on Poverty: A Handbook for Practitioners.] Directions in Development, World Bank, Washington, D.C.

See also

* Important publications in program evaluation
* Policy studies
* Policy analysis
* Participatory Impact Pathways Analysis
* Program evaluation
* Impact assessment

References


Wikimedia Foundation. 2010.

Игры ⚽ Поможем сделать НИР

Look at other dictionaries:

  • Impact assessment — (IA) is a process aimed at structuring and supporting the development of policies. It identifies and assesses the problem at stake and the objectives pursued. It identifies the main options for achieving the objective and analyses their likely… …   Wikipedia

  • Impact Environnemental — L impact environnemental désigne l ensemble des modifications qualitatives, quantitatives et fonctionnelles de l Environnement (négatives ou positives) engendrées par un projet, un processus, un procédé, un ou des organismes et un ou des produits …   Wikipédia en Français

  • ÉVALUATION - L’évaluation des curricula — Dans le cadre des projets de rénovation de l’enseignement des années soixante, le terme «curriculum» a été introduit pour désigner l’ensemble des composantes qui interviennent dans la mise en place d’un programme de formation cohérent: le plan… …   Encyclopédie Universelle

  • Evaluation de la recherche — Évaluation de la recherche scientifique Vie scientifique Chercheur Laboratoire Recherche Financement Congrès Publication …   Wikipédia en Français

  • Evaluation de la recherche scientifique — Évaluation de la recherche scientifique Vie scientifique Chercheur Laboratoire Recherche Financement Congrès Publication …   Wikipédia en Français

  • Évaluation de la recherche — scientifique Vie scientifique Chercheur Laboratoire Recherche Financement Congrès Publication …   Wikipédia en Français

  • Evaluation — is systematic determination of merit, worth, and significance of something or someone using criteria against a set of standards. Evaluation often is used to characterize and appraise subjects of interest in a wide range of human enterprises,… …   Wikipedia

  • Evaluation en Formation d'adultes — Évaluation de la formation en entreprise L évaluation de l efficacité de la formation professionnelle est une problématique fréquente dans les entreprises. La recherche en gestion des ressources humaines s est depuis longtemps penchée sur cette… …   Wikipédia en Français

  • Évaluation de la formation — en entreprise L évaluation de l efficacité de la formation professionnelle est une problématique fréquente dans les entreprises. La recherche en gestion des ressources humaines s est depuis longtemps penchée sur cette question et, malgré les… …   Wikipédia en Français

  • Évaluation en Formation d'adultes — Évaluation de la formation en entreprise L évaluation de l efficacité de la formation professionnelle est une problématique fréquente dans les entreprises. La recherche en gestion des ressources humaines s est depuis longtemps penchée sur cette… …   Wikipédia en Français

Share the article and excerpts

Direct link
Do a right-click on the link above
and select “Copy Link”