Innovating product design is crucial for firms operating in the digital sector as it is closely linked with innovation capability and, therefore, with firm performance and productivity. In this paper, we run a randomized controlled trial to assess if participating in an open innovation initiative increases SMEs’ capability to design more competitive digital products. More specifically, the intervention aimed at increasing firms’ knowledge of the Design Sprint and their readiness to implement user-centered design techniques.
IGL Trials Database
IGL curates a database with randomised controlled trials in the field of innovation, entrepreneurship and growth. Browse our list of topics, see it as a map, or use the search function below.
2024
In late 2021, Phoenix Group, a FTSE 100 financial services firm and long-term partner of MoreThanNow, asked us to evaluate the impact of an Inclusive Leadership Programme. Everyone involved in the project was aware of the limited evidence for the effectiveness of online diversity training, but the team at Phoenix Group were interested in whether bespoke, best-in-class, inclusivity training for leaders would change behaviour.
2023
This experiment involved making the information on the WBSO website clearer and more personally relevant to entrepreneurs. The visibility of the call-to-action was also enhanced. The study showed that entrepreneurs were prompted to spend more time exploring the possibilities offered by the Research and Development (Promotion) Act (WBSO) and that they read the information more carefully.
This experiment is listed in the BINN report "A wealth of behavioural insights - 2023 edition". Further information on the trial and authors may be available elsewhere.
2023
Enhanced cybersecurity of SMEs - Can a phishing test make companies less vulnerable to cyberattacks?
Small and Medium-sized Enterprises are particularly vulnerable to cyberattacks. A large-scale field experiment amongst SME employees showed that a phishing test is effective in the short term, but not in the medium or long term.
This experiment is listed in the BINN report "A wealth of behavioural insights - 2023 edition". Further information on the trial and authors may be available elsewhere.
2023
Drawing the attention of innovators to climate change is important for green innovation. We report an email field experiment with MIT using messages about the impact of climate change to invite innovators (SBIR grantees) to apply to a technology competition. We vary our messages on the time frame and scale of the human cost of climate change across scientifically valid scenarios. Innovator attention (clicks) is sensitive to climate change messaging. These changes in clicks also predict higher application rates.
2023
The Ministry of Justice and Security developed a behavioural intervention aimed at inspiring individuals to adopt safe cyber practices: 'Valse email? Meld het via de meldknop' (Fake email? Report it using the report button). Thanks to this behavioural intervention, employees are ten times more likely to report suspicious emails internally. Moreover, click rates on links in suspicious emails have significantly decreased.
2023
This study examines the influence of information constraints on firms’ efficiency in using digital technologies, focusing on business websites. Through two natural field experiments in the UK, we provide firms with benchmarked performance information on their websites. The experimental designs enable us to assess the salience of the information provided and heterogeneity linked to prior experience and catch-up potential.
2023
Can a set of low-cost behavioural nudges encourage more small businesses to adopt productivity-raising digital technologies? This randomised controlled trial sought to test whether businesses could be nudged into using a cloud-based system to improve the efficiency of invoice processing. All participants in the trial were offered access to the system free of charge for a 12-month period, with a treatment group receiving weekly email reminders to make use of the system.
2023
Many school systems across the globe turned to online education during the COVID-19 pandemic. This context differs significantly from the prepandemic situation in which massive open online courses attracted large numbers of voluntary learners who struggled with completion. Students who are provided online courses by their high schools also have their behavior determined by actions of their teachers and school system.
2023
We report the results of a field experiment that randomly placed unemployed young people as apprentices with small firms in Ghana and included no cash subsidy to firms (or workers) beyond in-kind recruitment services. Treated firms experienced increases in firm size of approximately half a worker and firm profits of approximately 10 percent for each apprentice placement offered, documenting frictions to novice hiring.
2023
We document interest in labor reallocation among small firm owners in Ghana; 60% and 41%, respectively, self-report willingness to hire or work for the average local firm owner. Firm owners also exhibit high willingness-to-pay for information on a random subset of hiring firms and jobseeking firm owners, during a Becker-Degroot-Marschak exercise. Conditionally random variation in access to this information generates immediate labor adjustments within and between firms, though rarely of firm owners themselves, and impacts firm closure 5-months post-intervention.
2023
While evidence indicates that the notice and comment (N&C) process improves regulatory compliance by increasing trust in government, there is reason to doubt this mechanism’s viability in the digital realm. The lack of direct human interactions online can lead participating firms to feel unheard and unengaged. As a result, online N&C efforts can actually undermine firms’ views of the government’s regulatory authority and hamper efforts towards compliance.
2023
The design of research grants has been hypothesized to be a useful tool for influencing researchers and their science. We test this by conducting two thought experiments in a nationally representative survey of academic researchers. First, we offer participants a hypothetical grant with randomized attributes and ask how the grant would influence their research strategy. Longer grants increase researchers' willingness to take risks, but only among tenured professors, which suggests that job security and grant duration are complements.
2023
We show in a large-scale field experiment that a brief exposure to female role models working in scientific fields affects high school students’ perceptions and choices of undergraduate major. The classroom interventions reduced the prevalence of stereotypical views on jobs in science and gender differences in abilities. They also made high-achieving girls in grade 12 more likely to enrol in selective and male-dominated science, technology, engineering and mathematics programs in college.
2023
An online experiment investigated how behavioural techniques could be used to increase the likelihood of companies with 2 to 10 employees applying for assistance under the Subsidy scheme Improving Sustainability of SMEs (SVM ). The results show that an updated version of the website helps to clarify the subsidy. This effect is not reflected in the likelihood of these micro-SMEs actually applying for the subsidy.
This experiment is listed in the BINN report "A wealth of behavioural insights - 2023 edition". Further information on the trial and authors may be available elsewhere.
2022
The study investigates the role of information constraints and behavioral biases in the under-adoption of key business practices by micro-enterprises in Brazil. We combine a randomized control trial with online surveys to study these questions.
2022
This experiment tries to understand how managers respond to uncertainty when making research and development decisions. Three experiments were conducted with master’s degree students in a program focused on the intersection of business and technology.
2022
This study analyses a field experiment conducted on AngelList Talent, a large online search platform for startup jobs.
2022
We examine the influence of physical proximity on between-startup knowledge spillovers at one of the largest technology co-working hubs in the United States. Relying on the random assignment of office space to the hub's 251 startups, we find that proximity positively influences knowledge spillovers as proxied by the likelihood of adopting an upstream web technology already used by a peer startup.
2022
Climate change poses an urgent and existential threat to the wine sector. However, it is not easy for wineries and farmers to take action to reduce carbon emission comparing to adaptation. How can we encourage these actions? Farmers often seek information before take action, which influences their current risk perceptions of extreme weather condition or moral norms. Regarding the information, a positive approach focusing on empowering farmers to take action to address climate change is generally more successful at engaging people and minimizing defensive reactions.
2022
This paper tests whether providing more information on business practices can lead firms to seek out advice and improve their practices. The authors collaborated with a business advice provider in Brazil to implement a randomized experiment with 866 small firms. The treatment groups received different versions of an information sheet that benchmarked business practices to other firms and listed five practices to improve.
2021
This study asks why more small firms in developing countries do not use the market for professional business services like accounting, marketing, and human resource specialists and asks how this could be altered.
2021
This randomised experiment tested the impact of exogenously inducing higher financial aspirations among poor entrepreneurs.
2021
We examine how the behavior of software developers changes in response to removing gamification elements from GitHub, an online platform for collaborative programming and software development. We find that the unannounced removal of daily activity streak counters from the user interface (from user profile pages) was followed by significant changes in behavior. Long-running streaks of activity were abandoned and became less common. Weekend activity decreased and days in which developers made a single contribution became less common.
2020
In this study, we empirically examine the effect of sharing information with close or distant competitors as part of an incubation program. There is recent evidence of substantial heterogeneity in acceleration programs, with qualitative research highlighting that the main benefit for participants to these programs is the increased exposure to information and the feedback they obtain. Such exposure helps balance the bounded rationality of founders.
2020
Using survey and register data, this experiment estimates the effects of the information treatment brochure on awareness of WeGebAU, on take-up of WeGebAU and other training, and on subsequent employment.
2020
This paper explores what might motivate employees to participate in internal crowdsourcing, a peer-based approach to innovation.
2020
This paper compares how two common incentive schemes affect innovative performance in a field experiment run in partnership with a large life sciences company.
2020
This trial investigates whether excessively optimistic beliefs may play a role in the persistent demand for doctoral and post-doctoral training in science.