An RCT was used to investigate the effectiveness of an innovation support scheme (ISS) for SMEs in tackling age diversity challenges. The ISS included leadership training aimed at fostering team climate and valuing age diversity, and computer-based cognitive training for employees. Levels of recruitment into the trial, engagement in the interventions and response rates to surveys were lower than anticipated, which have all limited the potential to identify the impacts of the interventions.
IGL Trials Database
IGL curates a database with randomised controlled trials in the field of innovation, entrepreneurship and growth. Browse our list of topics, see it as a map, or use the search function below.
2023
There is a growing belief that scalable and low-cost AI assistance can improve firm decision-making and economic performance. However, running a business involves a myriad of open-ended problems, making it hard to generalize from recent studies showing that generative AI improves performance on well-definedwriting tasks. In our field experiment with 640 Kenyan entrepreneurs, we assessed the impact of AI-generated advice on small business revenues and profits.
2023
Measuring the returns of advertising opportunities continues to be a challenge for many businesses. We design and run a field experiment in collaboration with Yelp across 18,294 firms in the restaurant industry to understand which types of businesses gain more from digital advertising. We randomly assign 7,209 restaurants to freely receive Yelp’s standard ads package for three months. The scale of the experiment gives us a unique opportunity to assess the heterogeneity in advertising effectiveness across a variety of business attributes.
2023
Effective workplace management plays a crucial role in determining employee performance, retention, and subsequently, overall firm performance. While conventional management strategies often emphasize hierarchical relationships, peer-to-peer management, or "managing across," represents a promising yet largely unexplored approach. This study aims to investigate the impact of peer-to-peer management training on various employee outcomes and identify the conditions under which the intervention proves most effective.
2023
Understanding how to design policies to effectively reduce firm-level carbon emissions while minimizing impacts on economic growth is a question of central importance in the battle to mitigate climate change. The EU is proposing a Carbon Border Adjustment Mechanism (CBAM) that will tax imports to better reflect their carbon content. This project evaluates three policies that provide firms with training and assistance obtaining loans with the goal of mitigating the impacts of CBAM on Turkish SMEs.
2023
Whose problems do investors see as worth solving? I experimentally study how investors evaluate a startup idea based on the socioeconomic background of the founder, the target customer, and the (in)congruence between the two. I am also interested in how the socioeconomic background of investors themselves affect these evaluations. I aim to contribute to the research on diversity and inequality in entrepreneurial funding in which socioeconomic backgrounds have been relatively understudied.
2023
Management strategies significantly influence worker productivity, retention, career growth, and the overall performance of a firm. Traditional top-down approaches have typically underscored the importance of supervisors in shaping managerial quality and employee performance. Much research suggests that training supervisors to effectively manage their subordinates may be a useful way to enhance supervisor-worker relationships and, in turn, boost firm productivity. However, these approaches may face two primary challenges.
2023
An online experiment investigated how behavioural techniques could be used to increase the likelihood of companies with 2 to 10 employees applying for assistance under the Subsidy scheme Improving Sustainability of SMEs (SVM ). The results show that an updated version of the website helps to clarify the subsidy. This effect is not reflected in the likelihood of these micro-SMEs actually applying for the subsidy.
This experiment is listed in the BINN report "A wealth of behavioural insights - 2023 edition". Further information on the trial and authors may be available elsewhere.
2023
New AI tools have the potential to change the way workers perform and learn, but little is known about their impacts on the job. In this paper, we study the staggered introduction of a generative AI-based conversational assistant using data from 5,179 customer support agents. Access to the tool increases productivity, as measured by issues resolved per hour, by 14% on average, including a 34% improvement for novice and low-skilled workers but with minimal impact on experienced and highly skilled workers.
2023
In an RCT with US small businesses, we document that a large share of firms are not well-informed about bankruptcy. Many assume that bankruptcy necessarily entails the death of a business and do not know about Chapter 11 bankruptcy, where debts are renegotiated so that the business can continue operating. Small businesses are also unaware of a recent major reform that lowered the costs of bankruptcy procedures to enhance their protection.
2023
Does growth training help entrepreneurs scale-up new ventures? Our field experiment answers this question using data from 181 Singapore-based, early-growth entrepreneurs drawn from a broad range of industry sectors. Treatment content focused on three growth-catalyst tools relevant for formulating and executing innovation-led growth: business-model design, leveraging external networks, building internal teams. Treatment format comprised interactive lecture sessions and workshops on these tools supplemented by personalized coaching in applying the tools to entrepreneurs’ specific challenges.
2023
Failure is widely acknowledged as a critical component of the organizational learning and innovation processs. Learning from failure, in particular, seems extremely relevant in the context of entrepreneurship, where failure often emerges as the predominant outcome. Remarkably, most entrepreneurship training programs predominantly emphasize success stories of entrepreneurs, without leveraging the learning potential that come from stories of failure.
2023
This experiment involved making the information on the WBSO website clearer and more personally relevant to entrepreneurs. The visibility of the call-to-action was also enhanced. The study showed that entrepreneurs were prompted to spend more time exploring the possibilities offered by the Research and Development (Promotion) Act (WBSO) and that they read the information more carefully.
This experiment is listed in the BINN report "A wealth of behavioural insights - 2023 edition". Further information on the trial and authors may be available elsewhere.
2023
Entrepreneurs persist in business despite low returns. Following the Dunning-Kruger effect and threshold model of exit, we argue that entrepreneurs display general overconfidence in evaluating their relative ability and benchmarking information thus induce exit. To investigate, we administered a randomized controlled trial of benchmarking among 194 Singapore food-stall owners. Both control and treatment owners were informed of their own performance. Additionally, treatment owners were informed of their relative performance and best practices.
2023
Entrepreneurs in developing countries face a series of diverse constraints to growth, including lack of access to business skills, markets, and finance. The binding constraints vary from firm to firm, implying that the returns to possible interventions are likely to be heterogeneous.
2023
We study how local public infrastructure investment affects neighborhood economies. By tracking the impacts of US$68 million of randomized investments in Mexican municipalities, we document how government investment leads to sustained increases in the size and profitability of treated private-sector companies. Initially, wages rise to compensate for higher costs of living, inefficient firms die, and more efficient firms grow faster. Over the subsequent decade treated firms increase their capital stocks and revenues, suggesting durable improvements in the structure of the local economy.
2023
Enhanced cybersecurity of SMEs - Can a phishing test make companies less vulnerable to cyberattacks?
Small and Medium-sized Enterprises are particularly vulnerable to cyberattacks. A large-scale field experiment amongst SME employees showed that a phishing test is effective in the short term, but not in the medium or long term.
This experiment is listed in the BINN report "A wealth of behavioural insights - 2023 edition". Further information on the trial and authors may be available elsewhere.
2023
As more and more activities in the economy become digitized, analytics and data-driven decision-making (DDD) are becoming increasingly important. The adoption of analytics and DDD has been slower in small-to-medium enterprises (SMEs) compared to large firms, and reliable causal estimates of the impacts of analytics tools for small businesses have been lacking. We derive experiment-based estimates of the effect of an analytics tool on SME outcomes, analyzing the randomized introduction of eBay’s Seller Hub (SH), a data-rich seller dashboard.
2023
This study examines the influence of information constraints on firms’ efficiency in using digital technologies, focusing on business websites. Through two natural field experiments in the UK, we provide firms with benchmarked performance information on their websites. The experimental designs enable us to assess the salience of the information provided and heterogeneity linked to prior experience and catch-up potential.
2023
We show in a large-scale field experiment that a brief exposure to female role models working in scientific fields affects high school students’ perceptions and choices of undergraduate major. The classroom interventions reduced the prevalence of stereotypical views on jobs in science and gender differences in abilities. They also made high-achieving girls in grade 12 more likely to enrol in selective and male-dominated science, technology, engineering and mathematics programs in college.
2023
The Ministry of Justice and Security developed a behavioural intervention aimed at inspiring individuals to adopt safe cyber practices: 'Valse email? Meld het via de meldknop' (Fake email? Report it using the report button). Thanks to this behavioural intervention, employees are ten times more likely to report suspicious emails internally. Moreover, click rates on links in suspicious emails have significantly decreased.
2023
We evaluate the impact of a training program aimed at improving the relational atmosphere in the workplace. The program encourages prosocial behavior and the use of professional language, focusing primarily on leaders’ behavior and leader-subordinate interactions. We implement this program using a clustered randomized design involving over 3,000 headquarters employees of 20 large corporations in Turkey. We evaluate the program with respect to employee separation, pro- and antisocial behavior, the prevalence of support networks, and perceived workplace climate.
2023
We document interest in labor reallocation among small firm owners in Ghana; 60% and 41%, respectively, self-report willingness to hire or work for the average local firm owner. Firm owners also exhibit high willingness-to-pay for information on a random subset of hiring firms and jobseeking firm owners, during a Becker-Degroot-Marschak exercise. Conditionally random variation in access to this information generates immediate labor adjustments within and between firms, though rarely of firm owners themselves, and impacts firm closure 5-months post-intervention.
2023
First, we will recruit people to provide advice on whether to invest in actual start-up firms and to provide a justification for their decision. We create pairs of advisors that provide the same recommendation but differ by race and gender. Next, we recruit participants for the role of investors. Each participant is endowed with one dollar for each of the four investment rounds. The adviser provides her/his assessment and investment recommendation. The investor then decides how much to invest, and the outcome is revealed.
2023
Drawing the attention of innovators to climate change is important for green innovation. We report an email field experiment with MIT using messages about the impact of climate change to invite innovators (SBIR grantees) to apply to a technology competition. We vary our messages on the time frame and scale of the human cost of climate change across scientifically valid scenarios. Innovator attention (clicks) is sensitive to climate change messaging. These changes in clicks also predict higher application rates.
2023
Can a set of low-cost behavioural nudges encourage more small businesses to adopt productivity-raising digital technologies? This randomised controlled trial sought to test whether businesses could be nudged into using a cloud-based system to improve the efficiency of invoice processing. All participants in the trial were offered access to the system free of charge for a 12-month period, with a treatment group receiving weekly email reminders to make use of the system.
2023
Effective managers play a vital role in successful teams by creating a positive and productive team environment, assigning tasks, setting clear goals and expectations, and facilitating communication and collaboration among team members. In this paper, we employ a distinctive experimental design to identify the marginal advantage of effective managers, and the specific attributes that yield the greatest benefits to team performance.
2023
While evidence indicates that the notice and comment (N&C) process improves regulatory compliance by increasing trust in government, there is reason to doubt this mechanism’s viability in the digital realm. The lack of direct human interactions online can lead participating firms to feel unheard and unengaged. As a result, online N&C efforts can actually undermine firms’ views of the government’s regulatory authority and hamper efforts towards compliance.
2023
We study the allocation and productivity consequences of training production line supervisors in soft skills via a randomized controlled trial. Consistent with standard practice for training investments within firms, we asked middle managers – who sit above supervisors in the hierarchy – to nominate members of their supervisory team for training. Program access was randomized within these recommendation rankings. Highly recommended supervisors experienced no productivity gains; in contrast, less recommended supervisors’ productivity increased 12% relative to controls.