The Effect of Supplemental Instruction on Academic Performance: An Encouragement Design Experiment

Alfredo Paloyo, Sally Rogan () and Peter Siminski
Additional contact information
Sally Rogan: University of Wollongong

No 9696, IZA Discussion Papers from Institute of Labor Economics (IZA)

Abstract: While randomized controlled trials (RCTs) are the "gold standard" for impact evaluation, they face numerous practical barriers to implementation. In some circumstances, a randomized-encouragement design (RED) is a viable alternative, but applications are surprisingly rare. We discuss the strengths and challenges of RED and apply it to evaluate a mature Supplemental Instruction (SI) or PASS (Peer Assisted Study Session) program at an Australian university. A randomly selected subgroup of students from first-year courses (? = 6954) was offered large incentives (worth AUD 55,000) to attend PASS, which increased attendance by an estimated 0.47 hours each. This first-stage (inducement) effect did not vary with the size of the incentive and was larger (0.89) for students from disadvantaged backgrounds. Instrumental variable estimates suggest that one hour of PASS improved grades by 0.065 standard deviations, which is consistent with the non-experimental literature. However, this estimate is not statistically significant, reflecting limited statistical power. The estimated effect is largest for students in their first semester at university.

Keywords: Australia; selection bias; student outcomes; randomized-encouragement design; peer-assisted study session; supplemental instruction (search for similar items in EconPapers)
JEL-codes: C93 I21 I23 I24 (search for similar items in EconPapers)
Pages: 48 pages
Date: 2016-01
New Economics Papers: this item is included in nep-edu and nep-exp
References: View references in EconPapers View complete reference list from CitEc
Citations: View citations in EconPapers (14)

Published - published in: Economics of Education Review, 2016, 55, 57-69

Downloads: (external link)
https://docs.iza.org/dp9696.pdf (application/pdf)

Related works:
Journal Article: The effect of supplemental instruction on academic performance: An encouragement design experiment (2016)
Working Paper: The effect of supplemental instruction on academic performance: An encouragement design experiment (2016)
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:iza:izadps:dp9696

Ordering information: This working paper can be ordered from
IZA, Margard Ody, P.O. Box 7240, D-53072 Bonn, Germany

Access Statistics for this paper

More papers in IZA Discussion Papers from Institute of Labor Economics (IZA) IZA, P.O. Box 7240, D-53072 Bonn, Germany. Contact information at EDIRC.
Bibliographic data for series maintained by Holger Hinte ().