Beyond baseline and follow-up : the case for more t in experiments, Vol. 1 of 1

About

Countries

Data & Research

Learning

News

Projects & Operations

Publications

Topics

Home > Data & Research > Author Profile > Report Details

Beyond baseline and follow-up : the case for more t in experiments

Author:	McKenzie, David;	Collection Title:	Policy Research working paper ; no. WPS 5639
Country:	World;	Date Stored:	2011/04/25
Document Date:	2011/04/01	Document Type:	Policy Research Working Paper
Language:	English	Region:	The World Region
Report Number:	WPS5639	SubTopics:	Scientific Research & Science Parks; Economic Theory & Research; Science Education; Disease Control & Prevention; Statistical & Mathematical Sciences
Volume No:	1 of 1

Summary: The vast majority of randomized experiments in economics rely on a single baseline and single follow-up survey. If multiple follow-ups are conducted, the reason is typically to examine the trajectory of impact effects, so that in effect only one follow-up round is being used to estimate each treatment effect of interest. While such a design is suitable for study of highly autocorrelated and relatively precisely measured outcomes in the health and education domains, this paper makes the case that it is unlikely to be optimal for measuring noisy and relatively less autocorrelated outcomes such as business profits, household incomes and expenditures, and episodic health outcomes. Taking multiple measurements of such outcomes at relatively short intervals allows the researcher to average out noise, increasing power. When the outcomes have low autocorrelation, it can make sense to do no baseline at all. Moreover, the author shows how for such outcomes, more power can be achieved with multiple follow-ups than allocating the same total sample size over a single follow-up and baseline. The analysis highlights the large gains in power from ANCOVA rather than difference-in-differences when autocorrelations are low and a baseline is taken. The paper discusses the issues involved in multiple measurements, and makes recommendations for the design of experiments and related non-experimental impact evaluations.


Official Documents Official, scanned versions of documents (may include signatures, etc.)
File Type		Description	File Size (mb)

	PDF 36 pages	Official version*	2.52 (approx.)
	Text	Text version**

* The official version is derived from scanning the final, paper copy of the document and is the official,
archived version including all signatures, charts, etc.

** The text version is the OCR text of the final scanned version and is not an accurate representation of the final text.
It is provided solely to benefit users with slow connectivity.

Permanent URL for this page: http://go.worldbank.org/IJXJAKAK00