IGL Trials Database

IGL curates a database with randomised controlled trials in the field of innovation, entrepreneurship and growth. Browse our list of topics, see it as a map, or use the search function below.

2018
Thompson, N., Hanley, D.

As the largest encyclopedia in the world, it is not surprising that Wikipedia reflects the state of scientific knowledge. However, Wikipedia is also one of the most accessed websites in the world, including by scientists, which suggests that it also has the potential to shape science. This paper shows that it does. Incorporating ideas into Wikipedia leads to those ideas being used more in the scientific literature.

2017
Catalini, C., Tucker, C.

In October 2014, all 4,494 undergraduates at the Massachusetts Institute of Technology were given access to Bitcoin, a decentralized digital currency. As a unique feature of the experiment, students who would generally adopt first were placed in a situation where many of their peers received access to the technology before them, and they then had to decide whether to continue to invest in this digital currency or exit. Our results suggest that when natural early adopters are delayed relative to their peers, they are more likely to reject the technology.

2017
Atkin, D., Chaudhry, A., Chaudry, S., Khandelwal, A.

This article studies technology adoption in a cluster of soccer-ball producers in Sialkot, Pakistan. We invented a new cutting technology that reduces waste of the primary raw material and gave the technology to a random subset of producers. Despite the clear net benefits for nearly all firms, after 15 months take-up remained puzzlingly low.

2017
Bechtold, S., Engel, E.

U.S. intellectual property law is firmly rooted in utilitarian principles. Copyright law is viewed as a means to give proper monetary incentives to authors for their creative effort. Many European copyright systems pursue additional goals: Authors have the right to be named as author, to control alterations and to retract their work in case their artistic beliefs have changed. Protecting these “moral rights” might be justified by the preferences of typical authors.

2017
Breinlich, H., Donaldson, D., Nolen, P.J., Wright, G.C.

We present novel evidence from the results of a randomized controlled trial on the role that information plays in the perceptions of the benefits and costs of exporting. We first present results from a baseline survey of approximately 1,000 UK manufacturing firms to show that non-exporters hold substantially more negative beliefs about the costs and benefits of exporting relative to exporters.

2017
Khashabi, P., Heinz, M., Zubanov, N., Kretschmer, T., Friebel, G.

It is well-established that the effectiveness of pay-for-performance (PfP) schemes depends on employee- and organization-specific factors. However, less is known about the role of external forces. Investigating the role of market competition on the effectiveness of PfP, we theorize that there are two counteracting effects – business stealing and competitor response – that jointly generate an inverted U-shape relationship between PfP effectiveness and competition.

2017
Del Carpio, L., Guadalupe, M.

This paper investigates whether social identity considerations and norms may be driving occupational choices by women.

2017
Blasco, A., Jung, O., Lakhani, K.R., Menietti, M.

We report results of a natural field experiment conducted at a medical organization that sought contribution of public goods (i.e., projects for organizational improvement) from its 1200 employees. Offering a prize for winning submissions boosted participation by 85 percent without affecting the quality of the submissions. The effect was consistent across gender and job type. We posit that the allure of a prize, in combination with mission-oriented preferences, drove participation.

2017
Boudreau, K., Brady, T., Ganguli, I., Gaule, P., Guinan, E., Hollenberg, T., Lakhani, K.

Search costs continue to powerfully shape (and limit) the formation of collaborations between scientists. Formation of collaborations appears
to be highly sensitive to information-rich face-to-face interactions, which existing communications technologies may not sufficiently substitute.

2016
Boudreau, K., Lakhani, K., Menietti, M.

In the context of online developer tournaments this study found that added rivalry is likely to induce higher performance given that failing to exert effort will reduce the likelihood of winning a prize. Tournament organizers can leverage contest size, dividing competitors by ability, and opening entry to all, as policy tools to manipulate the performance of competitors, particularly when changes allow the reallocation of prize money.

2016
Boudreau, K., Lakhani, K.

Field experiments have the potential to provide unambiguous causal evidence on innovation topics while simultaneously assisting organisations with their innovation.

2016
Bechtold, S., Buccafusco, C., Sprigman, C. J.

All creativity and innovation build on existing ideas. Authors and inventors copy, adapt, improve, interpret, and refine the ideas that have come before them. The central task of intellectual property (IP) law is regulating this sequential innovation to ensure that initial creators and subsequent creators receive the appropriate sets of incentives. Although many scholars have applied the tools of economic analysis to consider whether IP law is successful in encouraging cumulative innovation, that work has rested on a set of untested assumptions about creators’ behavior.

2016
Boudreau, K., Guinan, E., Lakhani, K., Riedl, C.

This paper focuses on the evaluation of frontier scientific research projects and argues that the intellectual distance between the knowledge embodied in research proposals and an evaluator's own expertise systematically relates to the evaluations given.

2016
Gallus, J.

This natural field experiment tests the effects of purely symbolic awards on volunteer retention in a public goods context. The experiment is conducted at Wikipedia, which faces declining editor retention rates, particularly among newcomers. Randomization assures that award receipt is orthogonal to previous performance. The analysis reveals that awards have a sizeable effect on newcomer retention, which persists over the four quarters following the initial intervention.

2015

Organizations that depend on voluntary contributions face unique managerial challenges. In this project, we examine whether emphasizing the salience of project output (i.e., project outcome) or project input (i.e., labor costs) affect the quantity and quality of contributions using a randomized field experiment on the world's largest crowd science platform. We manipulate whether participants receive information that emphasizes their contribution to the eventual outcome of a task or information that emphasizes their contribution to the labor required for a task.

2015
Boudreau, K., Lakhani, K.

Workers who sort into institutional settings they prefer may work twice (or many more times) as hard in these preferred settings. This productivity effect is especially important in institutional settings where a taste for competition is strongest.

2015
Banal-Estañol, A., Pérez-Castrillo, D., Losa, V.

What is the impact of different types of knowledge transfer activities on the number and quality of business-science interactions? Motivated by the “European Paradox” (top-notch academic research but much weaker business-science links), this trial will test the impact of two interventions to raise awareness of academic research and connect it to businesses.

2015
Ganguli, I., Catalini, C.

How do different types of proximity impact collaboration and knowledge generation? How should we design research campuses to maximize the probability of breakthrough innovation taking place? Although information and communication technology has substantially lowered the cost of remote interactions, physical space and geographic proximity still play a major role in inventive activity. This project will explore how a research-intensive academic campus should be designed to increase the probability of breakthrough innovations taking place.

2015
Kuhn, J.M., Thompson, N.

Competition between firms to invent and patent an idea, or “patent racing,” has been much discussed in theory, but seldom analyzed empirically. This article introduces an empirical way to identify patent races, and provides the first broad-based view of them in the real world. It reveals that patent races are common, particularly in information-technology fields. The analysis is then extended to get the causal impact of winning a patent race, using a regression-discontinuity approach.

2015
Assaf, N., Cusolito, A.P., McKenzie, D.

Matching grants are one of the most common types of private sector development programs used in developing countries. But government subsidies to private firms can be controversial. A key question is that of additionality: do these programs get firms to undertake innovative activities that they would not otherwise do, or merely subsidize activities that would take place anyway? Randomized controlled trials can provide the counterfactual needed to answer this question, but efforts to experiment with matching grant programs have often failed.

2015
Celhay, P., Gertler, P., Giovagnoli, P., Vermeersch, C.

The adoption of new clinical practice patterns by medical care providers is often challenging, even when they are believed to be both efficacious and profitable. This paper uses a randomized field experiment to examine the effects of temporary financial incentives paid to medical care clinics for the initiation of prenatal care in the first trimester of pregnancy. The rate of early initiation of prenatal care was 34% higher in the treatment group than in the control group while the incentives were being paid, and this effect persisted at least 24 months or more after the incentives ended.

2015
Heite, J., Rosendahl Huber L., Kleine, M.

The Innovation Voucher Program analyzed in this study operates as a randomized controlled trial (RCT). This allows estimating the causal effect of the voucher on innovation and growth measures of beneficiaries, as well as their business outcomes in general. As a result, the evidence might be used to enhance voucher schemes and to provide further policy advice on how to effectively support small and medium-sized enterprises and their innovation activities in the future.

2015
Boudreau, K., Lakhani, K.

In the context of an online software development tournament, intermediate disclosure policy increased information and signaling in
the innovation environment. Final disclosure promoted higher levels of entry and effort and independent experimentation; while it generated a diversity of approaches, this led to considerable effort devoted to suboptimal approaches and overall performance achieved.

2014
Knight, A., Baer M.

Interpersonal effects of physical space indirectly affect performance for group engaged in knowledge work. Physical space shapes performance indirectly by affecting group members' arousal and territorial behaviour, which together influence information elaboration. The physical context in which a group works can shape interpersonal dynamics and ultimately group performance.

2013
Bakhshi, H., Edwards, J., Roper, S., Scully, J., Shaw, D., Morley, L., Rathbone, N.

A voucher programme for SMEs in Manchester, UK, to invest in creative projects showed significant positive, but short-term, effects on innovation and sales growth.

2013

Previous research in economics shows that compensation based on the pay-for-performance principle is effective in inducing higher levels of effort and productivity. On the other hand, research in psychology argues that performance-based financial incentives inhibit creativity and innovation. How should managerial compensation be structured if the goal is to induce managers to pursue more innovative business strategies?

2013
Paravisini, D. & Schoar, A.

This experiment provides direct evidence on how information technologies can lead to the decentralisation of decision-making processes within organisations, and how IT solutions may represent an effective and low-cost alternative to steepening or increasing monetary incentives. Providing credit scores increased the effort committees put into solving more difficult problems, increased committees' overall output, and reduced the need for higher-level manager involvement in the decision-making process.

2012
Boudreau, K., Guinan, E., Lakhani, K., Riedl, C.

This experiment in the context of medical research grants indicates a discount of novelty in research proposals, which may be due to evaluators internalising the average effects of novelty for potential concerns about the lower success rates. However, this censoring of novel projects means that experiments never get a chance to be run and thus the benefits of generating greater diversity of experiments are curtailed. This is of concern to policy makers and society because research funds are being allocated towards more incremental research as compared to high variability and potentially breakthrough efforts.

2011
Engle-Warnick, J., Escobal, J., Laszlo, S.

The lack of adoption of new farming technologies despite known benefits is a well-documented phenomenon in development economics. In addition to a number of market constraints, risk aversion predominates the discussion of behavioral determinants of technology adoption. We hypothesize that ambiguity aversion may also be a determinant, since farmers may have less information about the distribution of yield outcomes from new technologies compared with traditional technologies. We test this hypothesis with a laboratory experiment in the field in which we measure risk and ambiguity preferences.

2011
Davis, P. M.

Does free access to journal articles result in greater diffusion of scientific knowledge? Using a randomized controlled trial of open access publishing, involving 36 participating journals in the sciences, social sciences, and humanities, we report on the effects of free access on article downloads and citations. Articles placed in the open access condition (n=712) received significantly more downloads and reached a broader audience within the first year, yet were cited no more frequently, nor earlier, than subscription-access control articles (n=2533) within 3 yr.

Pages