Publications

  • Correcting for bias in hot hand analysis: An application to youth golf (Journal of Economic Psychology, 2018) - with Cotton, Christopher S., Frank McIntyre, Ardyn Nordstrom, and Joseph Price

    • Abstract This paper illustrates the problems that arise with traditional tests for the hot hand and proposes instead using a consistent dynamic panel data estimator, which corrects for these problems and is easy to implement. The issue is demonstrated by performing regression analysis on a sample of simulated data for junior golfers that does not include any dependence in a golfer’s performance across holes. The traditional regression analysis finds evidence of both hot and cold hand effects, even though the data is known to have no such effects. We resolve this problem by applying the consistent dynamic panel data estimator to a large dataset of amateur, youth golfers, to find no evidence of either hot or cold hand effects overall. When we restrict attention to the most-amateur of the golfers in our data, we do see weak evidence of a small hot hand. Thus, casual athletes may experience small hot hands, but the effect does not persist among more serious athletes. This may give insight into why the belief in the hot hand in professional sports exists, even when the evidence suggests otherwise.

 

Working Papers

  • It Takes a Village: The Impact of Community Mobilization Campaigns on Attitudes and Education (former job market paper—link)

    • Abstract This paper uses a quasi-randomized field experiment in Zimbabwe to assess the impact of large-scale community mobilization campaigns to build support for girls and marginalized groups in rural communities. I analyze the impact that the program has had on attitudes, the behaviour of teachers and caregivers, and the learning and progression outcomes of at-risk youth. The quantitative survey and learning assessment data I use for this is complemented by transcripts from focus groups and interviews, which I analyze using innovative text mining methods to measure changes in community sentiment towards marginalized groups. I find that the program improved community attitudes toward girls' education by 0.560 SD over the three and a half year project. This contributed to a 20.9 percentage point increase in the likelihood that students in the treatment group reported receiving enough support from their community to continue learning during COVID-19 school closures, along with other changes in the behaviours of community members and families. The program facilitated better learning and progression outcomes, with marginalized students performing 0.28 SD better on learning assessments after the project. These findings lead to two important conclusions about the efficacy of interventions designed to mobilize communities to reshape community attitudes and support marginalized students. The first is that community attitudes can be influenced in a relatively short time to become more supportive towards marginalized groups. The second is that these interventions can support education outcomes. This paper also demonstrates the usefulness of qualitative methods and text mining techniques for future experimental work.​

  • Impact of a Severe Drought on Education: More Schooling Does Not Imply More Learning (link)

    • Abstract In 2015 and 2016, Southern Africa experienced one of the severest droughts on record. The drought's intensity varied significantly across locations in unanticipated ways, providing a natural experiment to estimate the effect of large, negative agricultural shocks. We consider the impact of these shocks on children’s educational outcomes using data from a major education evaluation that was ongoing in rural Zimbabwe at the time of the drought, supplemented by remote-sensing satellite data to measure the drought intensity within each community. Droughts cause decreases in income and food access, which can affect household resource allocation and school attendance as well as learning. We find that drought exposure increased attendance, especially among the poorest students, which is consistent with droughts reducing work opportunities. At the same time, however, we do not see improvements in learning. The drought led to a significant decline in performance on literacy assessments for students who were experiencing food insecurity, and no significant impact on learning overall. This suggests that studies can arrive at very different conclusions depending on their measure of education performance. While most studies focus on either quantity of schooling or quality of learning, we highlight the importance of including both measures in an analysis.​

  • Understanding Education Outcomes in Zimbabwe: A Machine Learning Approach to Informing Program and Evaluation Design (working paper available upon request)

    • Abstract This paper uses multiple machine learning methods to describe the barriers and characteristics associated with different education outcomes. The data collected for this project is uniquely high-dimensional for a project of this scope, providing an opportunity to apply model shrinkage and tree-based methods that can identify the ``most important'' barriers and characteristics that explain education outcomes. This serves two main objectives. The first is to define the characteristics associated with negative education outcomes. As shown in Nordstrom (2022), effectively reaching the most marginalized students can be particularly important for education programs and policies to be effective in developing context. Therefore, identifying the characteristics and barriers associated with poor academic performance can help design projects that are better suited to addressing the barriers and characteristics of marginalized students. The second objective builds on this by specifically exploring the characteristics associated with poor progression outcomes. This is an area where the program this data came from did not see significant impact, and understanding the predictors of failed or successful progression outcomes may help inform future program design. I find that lack of support from households and schools, as well as pregnancy and motherhood, present the largest barriers to progression outcomes. While these are also important barriers to learning, other factors such as a student’s self-confidence were relatively more important. Learning outcomes are also important for explaining progression outcomes, however, the opposite does not appear to be true.​

  • Trade, poverty, and food security: A survey with implications for East Africa (link) — with Huw Lloyd-Ellis

    • Abstract We survey the latest research on the linkages between international trade, regional integration, poverty and food security in developing economies and draw out its implications for East Africa and future research. While there is now an extensive literature on the impacts of trade reform on poverty outcomes, research on the actual and potential effects of trade and regional integration on food security is much more limited. This reflects inconsistencies in the definition and measurement of food security, substantial data limitations, and the complexity of food systems themselves. Nevertheless, we argue that there is an urgent need and considerable scope for further research on these linkages.

  • Information and Engagement Campaigns in Support of Girls' Education Increase Math Performance and Enrolment (link) — with Christopher S. Cotton, Jordan Nanowski, and Eric Richert

    • Abstract We evaluate a large, randomized UKaid Girls' Education Challenge project in rural Zimbabwe, where the staggered roll-out of the project allows us to isolate the impact of intervention components specifically intended to improve knowledge of and support for girls' education. Such information and engagement campaigns are often included as components of major development projects, but previous work has been unable to isolate their importance and effectiveness separately from the broader projects. Using evidence from a randomized controlled trial, we show that information and engagement campaigns increased mathematics performance and school enrolment. In later periods, the program was expanded to provide resources such as bicycles and books and to update curriculum. During these later periods, we observed improvements in literacy, but no additional improvements in mathematics and enrolment beyond what was observed following the information and engagement campaign alone. 

Works In Progress

  • "What Affects the Education Outcomes of Marginalized Students? A Machine Learning Approach to Inform Program Design"

  • "Text Mining Approaches to Efficiently Select a Purposeful Qualitative Sample" – with Christopher Cotton

  • Pedalling to prosperity: Understanding the impact of bicycles on education outcomes. (2021) — with Christopher S. Cotton and Zachary Robb

  • "Vocational Training for Out-of-School students: A Qualitative Evaluation Using Text Mining in Zimbabwe" – with Christopher Cotton, Zachary Robb, Shannon Veenstra, and Lindsay Wallace

  • “Estimating the causal impact of trade liberalization on food security” — with Huw Lloyd-Ellis (based on published report “An Empirical Analysis of the Relationships Between Trade and Food Security” – see above)

  • “Quantifying qualitative data: An alternative to content analysis in survey data” — with Christopher Cotton

  • "Focusing on foundational skills: Understanding literacy and numeracy skill acquisition in Zimbabwe" — with Christopher Cotton

  • "Monetizing education benefits in cost-benefit evaluations" — with Christopher Cotton

 

Professional Research Reports

  • Cost-Benefit Analysis: Improving the Quality of Primary School Education in Malawi (2021) — for Copenhagen Consensus Center and the African Institute for Development Policy, with colleagues

  • Cost-Benefit Analysis: Reducing Secondary School Dropout Rates in Malawi (2021) — for Copenhagen Consensus Center and the African Institute for Development Policy, with colleagues

  • An Empirical Analysis of the Relationships Between Trade and Food Security (2020) — for USAID Kenya/East Africa, with Huw-Lloyd Ellis, Edward Carr, and Deanna Gordon

  • Understanding the Relationships Between Trade and Food Security: A Landscape Map (2020) — for USAID Kenya/East Africa, with Huw-Lloyd Ellis, Edward Carr, Anthony Cambas, and Deanna Gordon

  • Midline Evaluation of IGATE-T (2020) — for World Vision UK, with Christopher S. Cotton and Shannon Davis

  • Cost Benefit Analysis of Youth Ready Programs in Central America (2019) — for World Vision Canada, with Bahman Kashi

  • Baseline Evaluation of IGATE-T (2018) — for World Vision UK, with Christopher S. Cotton, Bahman Kashi, and Jay MacKinnon

 

Earlier Unpublished Projects