Scientists and funding agencies invest considerable resources in writing and evaluating grant proposals. But do grant proposal texts noticeably change panel decisions in single blind review? We report on a field experiment conducted by The Dutch Research Council (NWO) in collaboration with the authors in an early-career competition for awards of 800,000 euros of research funding. A random half of panelists were shown a CV and only a one-paragraph summary of the proposed research, while the other half were shown a CV and a full proposal.
IGL Trials Database
IGL curates a database with randomised controlled trials in the field of innovation, entrepreneurship and growth. Browse our list of topics, see it as a map, or use the search function below.
2024
We study whether information frictions and corruption perceptions deter firms from doing business with the government. We conduct two nationwide randomized con- trolled trials (RCTs) in collaboration with the national anti-corruption and public procurement supervisory agency in Uganda.The first RCT aims to increase transparency on available procurement opportunities. We provide firms with direct and timely access to information about government tenders over a two-year period, approximating the existence of a centralized portal for tender notices typical of e-procurement reforms.
2024
Social ventures that are fundraising through crowdfunding often involve major donors to influence the contributions of smaller donors. We theorize that male and female donors will respond differently to alternative major-donor contribution schemes that are commonly used by social ventures. In a field experiment, donors were randomly assigned to receive one of three solicitation messages about a pair of projects that were seeking funds through crowdfunding. All donors received identical messages, with the exception that information on major-donor involvement was varied across conditions.
2023
Science funding agencies such as the NIH, NSF, and their counterparts around the world are often criticized for being too conservative, funding incremental innovations over more radical but riskier projects. One explanation for their conservatism is the way the agencies use peer review of scientific proposals. Peer review is the cornerstone of research allocation decisions, but agencies typically base decisions on a simple average of peer review scores. More novel ideas are less likely to gain consistently high ratings across evaluators and are less likely to be funded.
2023
Whose problems do investors see as worth solving? I experimentally study how investors evaluate a startup idea based on the socioeconomic background of the founder, the target customer, and the (in)congruence between the two. I am also interested in how the socioeconomic background of investors themselves affect these evaluations. I aim to contribute to the research on diversity and inequality in entrepreneurial funding in which socioeconomic backgrounds have been relatively understudied.
2023
We conducted two randomized controlled trials (RCTs) to evaluate the impact of government-guaranteed loans offered by the Chilean and Colombian governments. The public funds of these programs greatly expanded following the start of the Covid-19 pandemic and offered loans to Micro, Small and Medium Enterprises to mitigate the negative impact of the shock. Through a collaboration with private banks, we launched two experiments which offered loans to a sub-set of the 10,072 Chilean and 3,079 Colombian small businesses that took part in our experiments.
2023
Female innovators raise fewer resources from investors, even when their ventures are similar to those of all-male teams. Efforts to mitigate the disparities have typically focused on changing how founders seek investment. However, the causes of gender disparities are systemic: in uncertain contexts, evaluators value women’s competence or leadership potential lower than men’s, and investors inquire more about risks when facing female founders than males.
2023
Gender differences in research funding exist, but bias evidence is elusive and findings are contradictory. Bias has multiple dimensions, but in evaluation processes, bias would be the outcome of the reviewers’ assessment. Evidence in observational approaches is often based either on outcome distributions or on modeling bias as the residual. Causal claims are usually mixed with simple statistical associations.
2023
The design of research grants has been hypothesized to be a useful tool for influencing researchers and their science. We test this by conducting two thought experiments in a nationally representative survey of academic researchers. First, we offer participants a hypothetical grant with randomized attributes and ask how the grant would influence their research strategy. Longer grants increase researchers' willingness to take risks, but only among tenured professors, which suggests that job security and grant duration are complements.
2023
We study how local public infrastructure investment affects neighborhood economies. By tracking the impacts of US$68 million of randomized investments in Mexican municipalities, we document how government investment leads to sustained increases in the size and profitability of treated private-sector companies. Initially, wages rise to compensate for higher costs of living, inefficient firms die, and more efficient firms grow faster. Over the subsequent decade treated firms increase their capital stocks and revenues, suggesting durable improvements in the structure of the local economy.
2023
First, we will recruit people to provide advice on whether to invest in actual start-up firms and to provide a justification for their decision. We create pairs of advisors that provide the same recommendation but differ by race and gender. Next, we recruit participants for the role of investors. Each participant is endowed with one dollar for each of the four investment rounds. The adviser provides her/his assessment and investment recommendation. The investor then decides how much to invest, and the outcome is revealed.
2023
This study is focused on the relationship between borrowing constraints, access to cutting-edge technology and information about cutting-edge technology on the performance of U.S. online businesses. With the help of two large U.S. technology companies we will be able to randomize access to loans and free cloud computing credits (as well as information about the potential use of technology) to otherwise identical (generally small, but fast growing) firms, to see if they will have a causal impact on firm development.
2022
This lab-in-the-field experiment will measure the gender bias in entrepreneurship and investment among youth and credit officers in Ethiopia. Chigign Tobiya “Ethiopia Emerges” is a television show in Ethiopia where entrepreneurs pitch their business ideas to a panel of business tycoons for a chance to get investment funding.
2022
In many scientific contexts, peer review can be either single-blind or double-blind: in single-blind review, research work (e.g., manuscripts, proposals) is reviewed alongside information on the author(s), whereas in double-blind review, information on the author(s) is withheld. We will report results from a randomized experiment conducted in collaboration with a grantmaking body, in the context of the grantmaker reviewing proposals in one field of science.
2022
Microcredit promised business growth for small firms lacking access to banking loans. Although microcredit has reached millions, recent randomized evaluations find limited average business impacts. Critics often blame contract rigidity, specifically the fixed and frequent installments, for the lack of productive risk-taking. But such rigidity may instill borrower discipline. This study partnered with a Colombian lender that offered first-time borrowers a flexible loan that permitted delaying up to three monthly repayments.
2022
This paper studies whether informational frictions prevent firms from accessing government support using a randomised controlled trial. We focus on two Portuguese COVID-19 relief programs, providing (i) wage support for workers who are kept on payroll and (ii) credit lines backed by government guarantees. We randomly assign firms to a treatment providing either simplified information about a program, or a combination information and step-by-step application support. We find a significant treatment effect on take up of the wage support program.
2022
We study the demand for government participation in China’s venture capital and private equity market. We conduct a large-scale, non-deceptive field experiment in collaboration with the leading industry service provider, through which we survey both sides of the market: the capital investors and the private firms managing the invested capital by deploying it to high-growth entrepreneurs. Our respondents together account for nearly $1 trillion in assets under management.
2022
Resource allocation decisions play a dominant role in shaping a firm’s technological trajectory and competitive advantage. Recent work indicates that innovative firms and scientific institutions tend to exhibit an anti-novelty bias when evaluating new projects and ideas. In this paper, we focus on shedding light into this observed pattern by examining how evaluator expertise in the problem’s focal domain shapes the relationship between novelty and feasibility in evaluations of quality for technical solutions.
2022
By enabling smaller loans, broader geographic reach, and less human bias in decision-making, process automation may reduce racial disparities in access to financial services. We find evidence for all three channels in a setting where private lenders faced no credit risk but decided who to serve: the Paycheck Protection Program (PPP), which provided loans to small businesses during COVID-19. Black-owned firms disproportionately obtained their PPP loans from fintech lenders, especially in areas with high racial animus.
2022
We seek to understand what is limiting women's access to finance, in particular for highly skilled start-up entrepreneurs. To investigate supply side constraints, we run a lab-in-the-field experiment in which loan officers in Uganda evaluate several business ideas based on real pitch decks from start-ups. We separate biases in idea evaluation from other constraints (such as gender specific differences in the ability to implement a project, or in external constraints that start-up entrepreneurs are facing).
2022
This impact evaluation aims to measure the effect of a program that combines business training, mentoring, and a large cash transfer on high-potential small and medium businesses in Chile. 250 out of the top 500 firms participating in a business plan competition will be randomly selected to receive all three components of the program, while the remaining firms will receive none of them.
2021
Do capital grants improve microenterprise productivity? We use the lens of a production function to re-examine two previous randomised controlled trials that allocated capital to microenterprises. We find that productivity is higher for treated firms, and accounts for about 20-30 percent of the revenue effects of capital grants. Although long-run estimates are noisy, point estimates indicate that these productivity effects are sustained six years after the grants.
2021
The Small Business Administration (SBA) aims to restore small business revenue and sustain jobs after disasters. SBA is interested in understanding the impact of community-based approaches to help small businesses respond and recover to the COVID-19 pandemic. In spring 2020, the Dallas City Council used CARES Act funding to set up the Small Business Continuity Fund (SBCF) to help small businesses affected by the economic fallout from the COVID‐19 pandemic.
2020
Innovative firms with good ideas may still struggle to fine-tune them to the stage where they can attract outside funding. We conduct a five-country randomized experiment that tests the impact of an investment readiness program. Firms then pitched their ideas to independent judges. The program resulted in a 0.3 standard deviation increase in the investment readiness score. Two years later, the average impacts on firm investment outcomes are positive, but small in magnitude, and not statistically significant.
2020
While prior research shows a significant gender gap in traditional equity financing, with mostly male investors who prefer male founders, emerging evidence indicates that gender gaps in funding may not translate to rewards-based crowdfunding, where female entrepreneurs may have an advantage, particularly with female investors. We seek to examine founder gender preferences in the context of equity crowdfunding, which represents a direct counterpart to traditional equity financing and which is a “higher-stakes” context than rewards-based crowdfunding.
2020
This paper discusses implementing a lab-in-the-field experiment with 334 Turkish loan officers to test for the presence, and learn about the mechanisms, of gender discrimination in small business lending.
2020
The main objective of this project is to test the effects of feedback with and without relative ranking scores on SMEs and first-time applicants performance in the funding program “General Programme” of the FFG, and business performance after the program. The feedback for each firm will be based on evaluations scores of the respective funding proposal from project evaluators in the FFG. The participants in the RCT are all Start-ups, SMEs, and large companies who are first-time applicants accepted into the funding program in the timespan of a year.
2019
A field experiment in Sri Lanka provided wage subsidies to randomly chosen microenterprises to test whether hiring additional labor benefits such firms, and whether a short-term subsidy can have a lasting impact on firm employment. Using 12 rounds of surveys to track dynamics four years after treatment, we find that firms increased employment during the subsidy period. Treated firms were more likely to survive, but there was no lasting impact on employment, and no effect on profitability or sales either during or after the subsidy period.
2019
We explore how variation in entrepreneurs' displayed passion affects informal investor interest in start-up ventures by examining neural responses to entrepreneurs' pitches using functional Magnetic Resonance Imaging (fMRI). We find that founders displaying high passion increase investor neural engagement by 39% and investor interest in the venture by 26% over those displaying low passion. A one standard deviation increase in neural engagement is associated with an 8% percent increase in investors' interest in investing in a start-up company relative to the mean.
2019
User entrepreneurs are responsible for the most important innovations in many industries, but little research has explored the performance of firms founded by user entrepreneurs. While user entrepreneurs have a deep knowledge of customer needs that facilitates the identification of innovative solutions, they tend to lack the relevant business knowledge (e.g., market, production, operational and organizational) to successfully exploit opportunities and grow their ventures.