IGL Trials Database

IGL curates a database with randomised controlled trials in the field of innovation, entrepreneurship and growth. Browse our list of topics, see it as a map, or use the search function below.

2016
Boudreau, K., Guinan, E., Lakhani, K., Riedl, C.

This paper focuses on the evaluation of frontier scientific research projects and argues that the intellectual distance between the knowledge embodied in research proposals and an evaluator's own expertise systematically relates to the evaluations given.

2016
Gallus, J.

This natural field experiment tests the effects of purely symbolic awards on volunteer retention in a public goods context. The experiment is conducted at Wikipedia, which faces declining editor retention rates, particularly among newcomers. Randomization assures that award receipt is orthogonal to previous performance. The analysis reveals that awards have a sizeable effect on newcomer retention, which persists over the four quarters following the initial intervention.

2016
Boudreau, K., Lakhani, K., Menietti, M.

In the context of online developer tournaments this study found that added rivalry is likely to induce higher performance given that failing to exert effort will reduce the likelihood of winning a prize. Tournament organizers can leverage contest size, dividing competitors by ability, and opening entry to all, as policy tools to manipulate the performance of competitors, particularly when changes allow the reallocation of prize money.

2016
Boudreau, K., Lakhani, K.

Field experiments have the potential to provide unambiguous causal evidence on innovation topics while simultaneously assisting organisations with their innovation.

2016
Bechtold, S., Buccafusco, C., Sprigman, C. J.

All creativity and innovation build on existing ideas. Authors and inventors copy, adapt, improve, interpret, and refine the ideas that have come before them. The central task of intellectual property (IP) law is regulating this sequential innovation to ensure that initial creators and subsequent creators receive the appropriate sets of incentives. Although many scholars have applied the tools of economic analysis to consider whether IP law is successful in encouraging cumulative innovation, that work has rested on a set of untested assumptions about creators’ behavior.

2015
Celhay, P., Gertler, P., Giovagnoli, P., Vermeersch, C.

The adoption of new clinical practice patterns by medical care providers is often challenging, even when they are believed to be both efficacious and profitable. This paper uses a randomized field experiment to examine the effects of temporary financial incentives paid to medical care clinics for the initiation of prenatal care in the first trimester of pregnancy. The rate of early initiation of prenatal care was 34% higher in the treatment group than in the control group while the incentives were being paid, and this effect persisted at least 24 months or more after the incentives ended.

2015
Heite, J., Rosendahl Huber L., Kleine, M.

The Innovation Voucher Program analyzed in this study operates as a randomized controlled trial (RCT). This allows estimating the causal effect of the voucher on innovation and growth measures of beneficiaries, as well as their business outcomes in general. As a result, the evidence might be used to enhance voucher schemes and to provide further policy advice on how to effectively support small and medium-sized enterprises and their innovation activities in the future.

2015
Boudreau, K., Lakhani, K.

In the context of an online software development tournament, intermediate disclosure policy increased information and signaling in
the innovation environment. Final disclosure promoted higher levels of entry and effort and independent experimentation; while it generated a diversity of approaches, this led to considerable effort devoted to suboptimal approaches and overall performance achieved.

2015

Organizations that depend on voluntary contributions face unique managerial challenges. In this project, we examine whether emphasizing the salience of project output (i.e., project outcome) or project input (i.e., labor costs) affect the quantity and quality of contributions using a randomized field experiment on the world's largest crowd science platform. We manipulate whether participants receive information that emphasizes their contribution to the eventual outcome of a task or information that emphasizes their contribution to the labor required for a task.

2015
Boudreau, K., Lakhani, K.

Workers who sort into institutional settings they prefer may work twice (or many more times) as hard in these preferred settings. This productivity effect is especially important in institutional settings where a taste for competition is strongest.

2015
Banal-Estañol, A., Pérez-Castrillo, D., Losa, V.

What is the impact of different types of knowledge transfer activities on the number and quality of business-science interactions? Motivated by the “European Paradox” (top-notch academic research but much weaker business-science links), this trial will test the impact of two interventions to raise awareness of academic research and connect it to businesses.

2015
Ganguli, I., Catalini, C.

How do different types of proximity impact collaboration and knowledge generation? How should we design research campuses to maximize the probability of breakthrough innovation taking place? Although information and communication technology has substantially lowered the cost of remote interactions, physical space and geographic proximity still play a major role in inventive activity. This project will explore how a research-intensive academic campus should be designed to increase the probability of breakthrough innovations taking place.

2015
Kuhn, J.M., Thompson, N.

Competition between firms to invent and patent an idea, or “patent racing,” has been much discussed in theory, but seldom analyzed empirically. This article introduces an empirical way to identify patent races, and provides the first broad-based view of them in the real world. It reveals that patent races are common, particularly in information-technology fields. The analysis is then extended to get the causal impact of winning a patent race, using a regression-discontinuity approach.

2015
Assaf, N., Cusolito, A.P., McKenzie, D.

Matching grants are one of the most common types of private sector development programs used in developing countries. But government subsidies to private firms can be controversial. A key question is that of additionality: do these programs get firms to undertake innovative activities that they would not otherwise do, or merely subsidize activities that would take place anyway? Randomized controlled trials can provide the counterfactual needed to answer this question, but efforts to experiment with matching grant programs have often failed.

2014
Knight, A., Baer M.

Interpersonal effects of physical space indirectly affect performance for group engaged in knowledge work. Physical space shapes performance indirectly by affecting group members' arousal and territorial behaviour, which together influence information elaboration. The physical context in which a group works can shape interpersonal dynamics and ultimately group performance.

2013

Previous research in economics shows that compensation based on the pay-for-performance principle is effective in inducing higher levels of effort and productivity. On the other hand, research in psychology argues that performance-based financial incentives inhibit creativity and innovation. How should managerial compensation be structured if the goal is to induce managers to pursue more innovative business strategies?

2013
Paravisini, D. & Schoar, A.

This experiment provides direct evidence on how information technologies can lead to the decentralisation of decision-making processes within organisations, and how IT solutions may represent an effective and low-cost alternative to steepening or increasing monetary incentives. Providing credit scores increased the effort committees put into solving more difficult problems, increased committees' overall output, and reduced the need for higher-level manager involvement in the decision-making process.

2013
Bakhshi, H., Edwards, J., Roper, S., Scully, J., Shaw, D., Morley, L., Rathbone, N.

A voucher programme for SMEs in Manchester, UK, to invest in creative projects showed significant positive, but short-term, effects on innovation and sales growth.

2012
Boudreau, K., Guinan, E., Lakhani, K., Riedl, C.

This experiment in the context of medical research grants indicates a discount of novelty in research proposals, which may be due to evaluators internalising the average effects of novelty for potential concerns about the lower success rates. However, this censoring of novel projects means that experiments never get a chance to be run and thus the benefits of generating greater diversity of experiments are curtailed. This is of concern to policy makers and society because research funds are being allocated towards more incremental research as compared to high variability and potentially breakthrough efforts.

2011
Davis, P. M.

Does free access to journal articles result in greater diffusion of scientific knowledge? Using a randomized controlled trial of open access publishing, involving 36 participating journals in the sciences, social sciences, and humanities, we report on the effects of free access on article downloads and citations. Articles placed in the open access condition (n=712) received significantly more downloads and reached a broader audience within the first year, yet were cited no more frequently, nor earlier, than subscription-access control articles (n=2533) within 3 yr.

2011
Engle-Warnick, J., Escobal, J., Laszlo, S.

The lack of adoption of new farming technologies despite known benefits is a well-documented phenomenon in development economics. In addition to a number of market constraints, risk aversion predominates the discussion of behavioral determinants of technology adoption. We hypothesize that ambiguity aversion may also be a determinant, since farmers may have less information about the distribution of yield outcomes from new technologies compared with traditional technologies. We test this hypothesis with a laboratory experiment in the field in which we measure risk and ambiguity preferences.

2010
Baer, M., Leenders, R., Oldham, G., Vadera, A.

A laboratory experiment with undergraduate students in a US university explores the effects of intergroup competition and changes in group membership on creativity and collaboration.

2006
Cornet, M., Vroomen, B., van der Steeg, M.

An innovation voucher scheme in the Netherlands appears to successfully encourage SMEs to work with public research institutes on innovative projects.

Pages