The SME Instrument in action: an effective and innovative programme facing challenges
About the report:
With €3 billion for 2014-2020, the EU’s SME instrument strives to support innovation in SMEs and start-ups by filling the gap in funding and increasing commercialisation of research results.
We assessed whether the SME instrument delivers the expected benefits. Overall, we concluded that it provides effective assistance to SMEs in developing their innovation projects and that having the EU branding helps companies to attract additional investment. The Commission competently manages the instrument. However, we recommend improving the targeting of beneficiaries, the geographical outreach and the selection of projects. Also, more can be done to attract additional funding that would help bring innovation projects to market.
As the SME Instrument has been redesigned for 2021-2027 as part of the European Innovation Council (EIC), we make recommendations in particular for preserving aspects of its design, improving project selection, enhancing business acceleration services and creating synergies with other financial instruments.
ECA special report pursuant to Article 287(4), second subparagraph, TFEU.
The SME Instrument was set up under the Horizon 2020 research framework programme to support innovation in small and medium-sized enterprises (SMEs). Its objective is to develop and capitalise on the potential of SMEs by filling the gap in funding for early stage high-risk projects and increasing private-sector commercialisation of research results. It is targeted towards innovative SMEs in the EU and 16 associated countries that show strong ambition to develop, grow and internationalise in all different types of innovation.II
With an overall budget of €3 billion for the period 2014-2020, the instrument provides grants to high-potential companies to either support them in developing a feasibility study (up to €50 000 in Phase 1) or in conducting research and development and market-testing (€2.5 million in Phase 2). Assistance may also be provided through coaching, mentoring or other business acceleration services (Phase 3).III
In this audit, we assessed whether the SME Instrument supports innovation by SMEs. We examined whether it has targeted the right type of SMEs; if it achieved wide geographic coverage; if the selection process and Commission support were effective, and if the Commission adequately monitored and followed up the instrument, in order to make improvements. We expect the observations arising from our audit and the recommendations we make to feed into the debate on how to set up and administer the SME instrument’s successor from 2020 onwards.IV
We found that the SME Instrument provides effective support to SMEs in developing their innovation projects and that having the EU branding that comes from receiving EU support helps companies to attract additional investment.V
Nevertheless, the instrument’s broad objectives and targets, together with the changes introduced during the course of its implementation, have caused some uncertainty for stakeholders. We identified a risk that the instrument funds some SMEs that could have been financed by the market.VI
Participation in the SME Instrument varies markedly between countries. This is partly due to external factors but also because of the varying levels of support provided by National Contact Points and limitations in the Commission’s marketing and communication activities.VII
We found that improvements have been made to evaluation and selection procedures during the lifetime of the instrument, with the oral presentation of project proposals to a panel of jury members being a particularly useful addition in identifying the best proposals. However, a two-way feedback between the evaluation stages is missing. In addition, some IT tools are not fit for purpose, thus undermining the process which is already under pressure.VIII
The resubmission of unsuccessful proposals is a large and increasing drain on management and evaluation resources without providing added value. Not only does it increase administrative costs, it also lowers the success rate, thus discouraging participation.IX
Phase 1 of the instrument provides effective support, thanks to its simple and fast selection process, the EU branding, and access it gives to business acceleration services. However, it imposes disproportionately high administrative costs on the Commission´s administration and its relevance is diminished in countries where similar programmes already exist.X
Phase 2 of the instrument, which provides a higher level of support with the aim of bringing the innovation to market, enjoys the same positive outcomes as Phase 1 and also helps SMEs in raising additional investment.XI
Nevertheless, we found that the majority of beneficiaries still need additional financing to support their innovative endeavours and bring their projects to market. The Commission has taken little action to create links between SMEs’ financing needs and EU-backed financial instruments, and its knowledge of beneficiaries’ financial needs is limited.XII
Coaching and business acceleration services have the potential to amplify the effects of the instrument but having been launched late, only a small share of SMEs made use of the services. Moreover, they have not been sufficiently tailored to the needs of beneficiaries.XIII
Monitoring of investment raised and company evolution is cost-efficient but it does not assess the true impact of the instrument. Although beneficiaries have managed to raise investments in addition to the grants received, imbalances exist among participating countries, with north-west European SMEs raising more private funding than those in the south and east of Europe.XIV
In the report, we recommend that the Commission should:
- improve marketing and communication strategy for the instrument;
- improve its support to National Contact Points (NCPs) for SMEs and the Enterprise Europe Network (EEN);refine the instrument selection procedure to make better use of resources and fund the best proposals;
- limit the number of times a proposal can be resubmitted and publish the success rate per project proposal;
- propose to Member States that the Commission manages schemes similar to Phase 1;
- preserve a scheme similar to Phase 2 in the next programming period, building on the existing results;
- enhance the business acceleration services by allocating appropriate resources; and
- identify and promote synergies between the SME Instrument and EU backed financial instruments.
Importance of SMEs and innovation in the EU economy01
According to the European Commission’s Annual Report on SMEs 2017/2018, SMEs account for 99 % of the companies operating in the EU non-financial business sector, 66 % of total employment and 57 % of value-added in the EU’s non-financial business sector.02
Both the European Parliament and the Council have stressed the importance of supporting innovation (particularly breakthrough innovation) and the growth of start-ups and SMEs. They have noted that support to innovative SMEs and start-ups is essential in order to maximise Europe’s potential for growth and socio‑economic transformation1. Academic studies2,3 have demonstrated the relationship between entrepreneurship, SME activity, economic growth and job creation.03
The Europe 2020 Strategy4 emphasises the importance of innovation in boosting growth and employment in the EU. “Innovation Union” is one of the Strategy’s seven flagship initiatives, aiming “to create an innovation-friendly environment that makes it easier for great ideas to be turned into products and services that will bring economy growth and jobs”5.
Increased focus on SME and innovation in H202004
H2020 is the eighth EU research framework programme. With a budget of €76.4 billion for the period 2014 to 2020, it ranks as the world’s largest public research and innovation programme6.05
H2020 has placed greater emphasis on innovation than any of its predecessors, by providing more funding for testing, prototyping, business-driven R&D and promoting innovative entrepreneurship. H2020 has also set a more ambitious target in terms of funds to be allocated to SMEs than any other previous framework programme: SMEs should receive a minimum of 20 % of the total combined budget of €9 billion under the pillars “Leadership in enabling and industrial technologies” and “Societal challenges”.06
A budget of €3 billion has been earmarked for the SME instrument (SME-I), which equates to 33 % of the SME target for the whole H20207.
What is the SME Instrument?07
The SME-I was set up under the Horizon 2020 (H2020) research framework programme (FWP) to support innovation in small and medium-sized enterprises (SMEs). It provides grants to high-potential companies to support them in developing a feasibility study (Phase 1) and in conducting research and development (R&D) and market-testing (Phase 2). Assistance may also be provided through coaching, mentoring or other business acceleration services (Phase 3). Available to SMEs in Member States and countries that have signed association agreements (associated countries)8, the SME-I aims to help companies scale up and internationalise.08
The SME-I is a novel instrument, since it allows SMEs to participate as single beneficiaries without necessarily being part of a consortium as usually required by research framework programmes. It targets projects having reached at least technology readiness level 6.09
The objective of the SME-I is to develop and capitalise on the potential of SMEs by filling the gap in funding for early stage high-risk research and innovation, and increasing private-sector commercialisation of research results. It is targeted at SMEs showing a strong ambition to grow and internationalise and shall be provided for all types of innovation where each activity has a clear European added value.10
Responsibility for policy development with respect to the SME-I lies with the European Commission’s DG Research and Innovation (DG RTD), while implementation is carried out by the Executive Agency for Small and Medium-sized Enterprises (EASME).11
The instrument comprises three phases (see Figure 1):
- Phase 1 (investigation of technical and commercial feasibility of a business idea): exploring the scientific or technical feasibility and commercial potential of new ideas. Grants of €50 000 are awarded with a 70 % co-financing rate from the EU.
- Phase 2 (development and demonstration): developing innovation for the purposes of demonstration, performance verification, testing, the development of pilot lines, validation for market replication, and other activities aimed at bringing innovation to investment readiness and maturity for market take-up. Grants of up to €2.5 million can be awarded with a 70 % co-financing rate.
- Phase 3 (additional EU support to enter the market): providing support, training and coaching, as well as facilitating access to risk finance. This phase consists of a bundle of services offered to beneficiaries in Phases 1 and 2. No additional grants are awarded in this phase.
Although the different phases are numbered, the SME-I is not sequential: there is no need to complete Phase 1 in order to participate in Phase 2. The services offered in Phase 3 may be provided at any point during implementation of the innovation project, or even after finalisation.
A short history of the SME Instrument13
The SME Instrument was launched in 2014, with a design based on the USA’s SBIR9 programme. Its “funnel model” would make a large number of low-level investments in feasibility studies for promising innovation projects (Phase 1), with the best progressing to Phase 2 and an increased level of funding. However, the obligation to pass through Phase 1 before Phase 2 was removed at the design phase, allowing applicants to directly apply to either.14
As for other parts of Horizon 2020, the SME Instrument is implemented via work programmes, which cover periods of two or three years, and with each work programme, the characteristics of the instrument can be modified according to policy intentions.15
The 2014-2015 and 2016-2017 work programmes divided the SME-I budget into thematic topics e.g. biotechnology, health, security. SMEs would apply to the topic, which fitted their project best.16
The 2018-2020 work programme featured a “European Innovation Council (EIC) Pilot” which grouped the SME-I together with certain other programmes – Future Emerging Technologies Open (FET Open), Fast Track to Innovation (FTI) and H2020 Prizes. The main changes introduced under the EIC Pilot affecting the SME-I were:
- a bottom-up approach in an open call without needing to apply to a thematic topic;
- a “pitch” by SMEs for selection in Phase 2: face-to-face interviews with a panel of experienced innovators;
- increased mentoring and coaching opportunities for all beneficiaries through Phase 3.
In June 2018, the Commission presented a proposal for a regulation establishing Horizon Europe post-202010. The proposal envisages an EIC as the third pillar in a framework programme with a budget of €10.5 billion that would “combine all EU support to breakthrough and market-creating innovation in one place” and comprise two instruments: the Pathfinder for Advanced Research and the Accelerator. Therefore, the previous Phase 1 would definitively be discontinued while actions similar to those in the previous Phases 2 and 3 would be included in the Accelerator11.18
In March 2019, the Commission modified the work programme and launched the “Enhanced EIC Pilot” to run from June 2019 to the end of 2020. The Enhanced EIC Pilot represents a transition towards the proposed EIC under Horizon Europe (post-2020), forging a closer relationship between the constituent parts and bringing significant changes to the SME-I. Phase 1 was discontinued and the following instruments were introduced:
- the “Pathfinder”, replacing the former FET-Open and FET-Proactive;
- the “Accelerator”, replacing the previous Phase 2:
- development and scaling-up of high-risk innovation by SMEs;
- introduction of the non-bankability concept12;
- grants of up to €2.5 million; and
- option for equity injection of up to €15 million (blended finance).
The EIC Pilot represented an evolution of the SME‑I, mostly in line with its original design, while the Enhanced EIC Pilot introduced changes facilitating a transition towards the proposed EIC under Horizon Europe. The SME-I is the largest element in both the EIC Pilot and EIC Enhanced Pilot, accounting for around two-thirds of the respective budgets.20
The proposal for the EIC under Horizon Europe, currently in legislative procedure, preserves some elements of the instrument such as a continued focus on SMEs and grant-only support. However, certain other aspects under consideration have yet to be developed or tested13.
Audit scope and approach21
This special report is the latest in a series of ECA publications examining financial support to innovative SMEs14. Both the European Parliament and the Council have stressed the importance of supporting innovative SMEs and start-ups in order to maximise Europe’s potential for growth. We expect the observations arising from our audit and the recommendations we make to feed into the multiannual financial framework debate on how to set up and administer the SME instrument’s successor from 2020 onwards.22
In this audit, we examined whether the SME Instrument was effective in supporting innovation by SMEs?23
The audit addressed whether:
- the instrument targeted the “right SMEs”(i.e., those with high innovation potential);
- the instrument achieved geographical reach as well as searching for excellence;
- the Commission’s selection process was designed to fund the best projects;
- the Commission provided effective support to beneficiaries;
- the Commission adequately monitored and followed up the instrument in order to make improvements.
Our audit therefore focused on the design, management and outputs of the SME-I and its evolution towards the EIC including the EIC Pilot. We included in our audit the grants awarded in the period January 2014 to May 2019.25
The audit combined evidence from a range of sources:
- a desk review of documents;
- an analytical data review;
- surveys of beneficiaries, unsuccessful applicants receiving a seal of excellence, remote evaluators and national innovation agencies (NIAs);
- information visits to Bulgaria, Denmark, France, Romania, Slovenia, Spain and the United Kingdom; and
- interviews with Commission Directorates-General, EASME, the European Investment Bank (EIB), European Investment Fund (EIF) and other relevant stakeholders.
For further details on our audit methodology and sources of evidence, see Annex I.
Targeting the right beneficiaries27
According to the H2020 Regulation15, the SME-I targets innovative SMEs with a strong ambition to develop, grow and internationalise.
Objectives and target group of the SME Instrument have changed during its implementation28
SME-I stakeholders pointed out in interviews and in response to our surveys that the SME-I would have benefited from a more precise definition of its target and objectives at its inception.29
This ambiguity, particularly concerning the type of companies being targeted by the SME-I, was also highlighted in the SME Experts Advisory Group (EAG) 2014 Report16. According to the EAG, additional resources and a deeper analysis of the intended target group would have allowed the Commission greater confidence in attracting the right type of applicants.30
The objectives in successive work programmes changed several times throughout implementation. The first two work programmes (2014-2015 and 2016-2017) focused on any innovation that boosted company growth and was new to the market. The work programmes for the EIC Pilot (2018-2020) and the Enhanced EIC Pilot (2019-2020) shifted focus towards “market-creating” innovation. By comparison, the SBIR programme has changed little since its renewal in 201117.31
The frequent changes introduced during the short life of the SME-I has led to confusion for key actors, such as the National Contact Points (NCPs), the Enterprise Europe Network (EEN) and applicants about what should be funded.32
During implementation of the SME-I, the type of companies targeted has shifted from mature companies that had participated in previous FWPs, to innovative and in particular, young companies without previous FWP experience. The introduction in 2018 of the bottom-up approach and the pitch under the EIC Pilot accelerated the move towards a more youthful mix of SMEs (see Figure 2).
The current age profile of beneficiaries matches that of companies identified in the Nesta study18 on the factors for growth and differences in job creation for companies. This indicates that the current portfolio of beneficiaries is better positioned to deliver growth and job creation.34
The bottom-up approach has solved the issue seen with the previous structure where companies would select the "topic" on which to apply for support, based on the different award success rates. It has also simplified the administrative procedures for the calls. An alternative approach may be appropriate where there is a need to ring-fence specific areas considered a priority for the EU.
Late introduction of non-bankability concept35
The SME-I aims to “fill the gap in funding for early stage high-risk research and innovation”19. However, the successive work programmes have not specified how to target SMEs facing difficulties in obtaining funding from other sources, and the concept of “non-bankability” was only introduced with the Enhanced EIC Pilot in 2019.36
According to various stakeholders interviewed, there is a risk of the SME-I crowding-out private investment. This was borne out in the results of our survey among beneficiaries. In Phase 2, 36 % of respondents believed that their projects could have received funding from the private sector, and 17 % replied that they could have used their company's own resources to fund innovation. Jury members also confirmed this risk in interview (see Figure 3).
However, the stakeholders highlighted the subsequent crowding-in effect generated by the EU grant that helps beneficiaries to later attract the additional funds needed to advance their innovation projects and scale up.38
The bankability of a project is a complex concept determined by several variables, such as volume of funds needed, timing and price. Given its complexity, most interviewees believed there was a need to define what bankability meant and how it should be measured.39
Prior to 2019, the bankability of projects was not considered in the SME-I selection process. Indeed the instrument awarded grants to some SMEs that could have been financed by the market. The introduction of the non-bankability concept requires clear provisions on how it can be demonstrated, particularly since the EU branding of the SME-I and the grant itself attract additional financial resources supporting beneficiaries’ innovation projects.
Varying levels of participation among countries – partly due to factors beyond the control of the Commission40
The main factor determining SME-I participation and project success is excellence. Therefore, given the contrasting innovation levels among Member States, an uneven distribution of funds is to be expected. At the same time, however, through H2020 the EU aims to ensure that the benefits of an innovation-led economy are widely distributed and maximised20.41
The graphs and maps below (Figure 4, Picture 1 and Picture 2) illustrate country-level statistics on the number of submitted applications and funding received relative to the number of SMEs, GDP and population. Annex II shows the distribution of SME-I funding per Member State in absolute and relative terms, the number of projects awarded, the number of proposals and the success rate per Member State.42
Traditionally, Horizon 2020 implementation analysis has featured two different groups of Member States: EU-15 and EU-1321. In the case of the SME Instrument, this distinction does not serve to explain the variation in funding received (see first column of Figure 4).
The level of participation in SME-I and project success rate are affected by several factors:
- innovation ecosystem and number of SMEs in the country;
- existence of a national strategy on the SME-I;
- effort made to promote the SME-I; and
- support provided by NCPs and the EEN.
While some of these factors are beyond the Commission’s control, others – such as the marketing and promotion of the instrument or the support provided by the NCPs – fall within its influence.45
Differences in success rates between countries are partly explained by existing variation in the levels of innovation. Figure 5 shows a strong correlation between success rates in the SME-I and the European Innovation Scoreboard Summary Innovation Index22.
A common characteristic of participant countries with high participation and success rates in the instrument is the presence of an active national innovation agency (NIA), which acts as intermediary with the innovative SMEs. Conversely, in the three Member States with the lowest level of participation (compared to the number of SMEs in the country) and the lowest success rates, there is no NIA.47
In our survey of national innovation agencies (NIAs), we asked whether they had national programmes supporting SMEs in applying for the SME-I. Just under half of NIAs confirmed that they had national programmes supporting SMEs applying for Phase 2, with 35 % reporting this for Phase 1 (see Figure 6). Interviewees noted that since the SME-I instrument was created, some national agencies had scaled down similar programmes and instead prepared their companies for SME-I.
Spain is a good example of a Member State with a national strategy supporting innovative companies that could be eligible for the SME-I. The Spanish authorities have set up a system to market the SME-I, actively searching for highly innovative companies and supporting them in applying for the instrument. Spain is the greatest beneficiary of the SME-I: it receives some 20 % of the total budget and has the highest number of applicant SMEs. Despite being a moderate innovator according to the European Innovation Scoreboard, it has one of the highest success rates. Ireland and Denmark also actively promote the instrument and prepare their SMEs for participation.49
In Member States visited with a low level of participation in the SME-I (in terms of funds awarded and success rate), awareness of the SME-I was limited. There was little specific support or promotion at national level or guidance for companies regarding the instrument. In turn, low success rates have discouraged other companies from applying to the SME-I. Moreover, the existence of alternative national programmes, which return higher success rates, has reduced the attractiveness of the SME-I for companies and auxiliary agents such as consultants.
Awareness affected by the absence of a targeted marketing and communication strategy at Commission level50
The SME-I represents a new form of support in the FWPs, targeting mainly single SMEs with highly innovative projects, with a market-driven approach.51
The traditional types of H2020 applicant (universities, large corporations and research centres) is familiar with the funding opportunities offered by H2020. These organisations have experience with both H2020 and previous FWPs and, in many cases, have dedicated staff managing applications and projects. The type of companies targeted by the SME-I generally have not participated in previous FWPs and may not even have included public funds in their finance strategy.52
We examined whether SME-I was promoted, implemented and monitored to provide easy access to the instrument for SMEs as set out in Council Decision 743/2013. We also looked at the extent to which marketing techniques were used to make the right companies aware that this funding opportunity exists and appropriate channels of communication must be identified and used to reach them.53
The Commission and EASME had a limited budget to launch communication activities and organise various events gathering potential beneficiaries of the SME-I, mainly H2020 information days. Reports published by the EAG highlighted the absence of a marketing strategy for the SME-I, and the need to identify the right “clients” and adjust communication channels and tools accordingly. The SME-I evaluation23 saw this as a possible explanation for varying penetration rates in the EU-28 countries, and pointed to the need to re-examine the communication and marketing strategy.54
Despite the efforts made to reach potential beneficiaries, the Commission did not have a structured marketing and communication strategy. It did not employ a sufficiently targeted approach to raise awareness among innovative SMEs of the funding opportunities offered by the SME-I.55
The Commission relies heavily on the promotion done at national level by the NCPs and the EEN to achieve uniform implementation of the SME-I. It considers the NCPs to be “the main structure for providing practical information and assistance to potential participants”. As SMEs are less familiar with H2020 than other participants in the FWP (see paragraph 51), the role of the NCPs is particularly important for SMEs. The NCPs are appointed and paid by the national authorities. They are responsible for ensuring that “the new programme becomes known and readily accessible to all potential applicants”24. However, as stated in the ECA special report 28/201825, the level of support offered by the NCPs varies among Member States. In some, they act as full-time NCPs; in others, they have to combine NCP tasks with other responsibilities.56
The level of support provided by the NCPs varies across Member States, influencing the level of participation and success rates. In only two of the six Member States visited were the NCPs fully dedicated to the role. The NCPs in two Member States held proposal-writing workshops and pre-screened applications. One organised mock jury pitches. Others did little, aside from hosting H2020 information days.57
The NCPs and EEN reported that the SME-I had been promoted mainly at national level with limited support from the European Commission, as the programme does not allocate the NCPs a specific budget for dissemination activities.58
Access4SMEs is an H2020 coordination and support action aiming to “facilitate transnational cooperation among NCPs for SMEs and access to risk finance, upgrade their skills and tools in order to raise their standard of support”26. Interviewees stated that Access4SMEs has been the main source of information on the SME-I for the NCPs, EENs and beneficiaries. However, the network was only set up in September 2016 – almost three years after the launch of the instrument – and so was not in place when its services would have been the most valuable.
Selection of projects59
An effective selection procedure is critical to ensuring that the best applications are chosen for funding. In view of this, the selection procedure should have sufficient resources and assign the appropriate type of experts to each stage of the evaluation.60
The SME Instrument is based on a continuously open call for proposals, with four cut-off dates per phase per year. The evaluation process is carried out remotely by four independent evaluators per proposal. Since 2018, the selection procedure for Phase 2 grants has included a presentation of the projects to a jury, which is a second stage of evaluation conducted by a panel of six experts, mostly investors.
Limited resources for evaluation and remote evaluation procedure overloaded by high number of submissions61
EASME receives and manages a very high number of proposals at each of the four cut-off dates per year for each of the two phases. At the last cut-off date for 2018, it received more than 1800 applications for Phase 2 and 2200 for Phase 1.62
The evaluation process is challenged by a combination of limited resources and a high number of submissions. Evaluators have only 1.6 hours in Phase 1 and 2.4 hours in Phase 2 to complete the evaluation and its documentation, although applications are lengthy (10 pages excluding annexes for Phase 1 and 30 pages excluding annexes for Phase 2).63
In our survey, only 34 % of Phase 2 evaluators responded that the 2.4 hours allocated by the Commission to evaluate the proposals was sufficient. The average time needed was 5.1 hours. For Phase 1,56 % of respondents were satisfied, requiring three hours instead of 1.6 hours allocated by the Commission (see Figure 7).
The evaluators replying to our survey were mostly satisfied with the guidance and training provided, though they would like to receive feedback on their evaluations and statistics of outcomes, enabling them to benchmark and improve their performance. They expressed concern about the training for new evaluators and the consequent variability in their scoring. Statistics from EASME confirm this variability and H2020 rules require that 25 % of evaluators are newcomers.
Presentation to jury largely improves the selection procedure while complying with time-to-grant65
The introduction of the presentation of projects to a jury in 2018 was a positive change, since it compensates for the weaknesses inherent in a remote evaluation and allows for the verification of the practicality of the project and the potential of the team to implement it. Nevertheless, certain elements remain sub-optimal.66
The jury members assess 20 presentation of projects during an evaluation week and are expected to read the documents submitted by applicants in advance. However, the jury members we interviewed felt that they did not receive the documents sufficiently in advance to review potentially 1 600 pages of application information.67
They also suggested having access to the comments from the remote evaluators’ reports. In doing so, useful knowledge would be retained, thereby improving efficiency, given the limited time available for preparing and discussing the presentation of projects to the juries. Similarly, evaluators considered that the quality of their evaluations would be improved if they received the jury members’ comments on the proposals they had evaluated.68
No systematic due diligence is currently performed on applications reaching the presentation stage. Jury members indicated the need for a “light” due diligence process to verify the accuracy of the information provided by applicants on patents, company profile and team composition.69
The Commission set the time-to-grant (time between the cut-off date and the signature of the grant agreement) target at a maximum of three months for Phase 1 and six months for Phase 2. Actual time-to-grant has decreased since the start of the programme and despite the introduction of the presentation to juries in 2018, in that year EASME signed 90 % of the grants within the target time.
Some IT tools pose risks for the evaluation process70
Applicants submit proposals online via the electronic proposal submission system on the H2020 Participant Portal.71
To arrange presentations of projects and compose juries with suitable skills, EASME uses a spreadsheet workbook, which is vulnerable to breakdown that could cause delays and jeopardise an evaluation procedure.72
Since there are no dedicated IT tools to reimburse applicants for their participation in the pitch, they are registered as evaluators in the internal expert management system (EMI). Consequently, there is a risk that they could accidentally be contacted for the purpose of evaluating proposals.73
In addition, changes in the selection process introduced in September 2019 under the Enhanced EIC pilot (request for financial data from participants and technology readiness level information) require bolt-on solutions that have not yet been developed.
Resubmission of proposals straining evaluation resources74
There is no limit to the number of times that an unsuccessful application can be resubmitted to the SME-I. At evaluation, a resubmitted proposal receives the same treatment as any other initial application, with no information from previous evaluations being carried forward.75
The additional cost to the applicant of resubmitting an unchanged proposal is negligible. The number of resubmitted applications has been steadily increasing and now forms a sizeable proportion of total submissions. For the latest 2018 Phase 2 cut-offs (see Figure 8), 66 % of applications were resubmissions, with half of these appearing for at least the third time.
The increase of applications over time is only due to the resubmissions. The number of new projects applying for Phase 2 has remained stable at 500 applications per cut-off (see Figure 9).
Resubmissions place a significant and increasing strain on evaluation resources. Between 2015 and 2018, the cost of evaluating proposals on their third and subsequent resubmission – considering only remote expert evaluators’ fees – was over €4.3 million (including more than €1.8 million in 2018).78
The H2020 mid-term evaluation suggested that oversubscription discouraged participation, impaired the quality of evaluations, was a drain on resources and left a number of high-quality proposals unfunded.79
The average success rate for SME-I submissions is 4.7 % in Phase 2 and 8.6 % in Phase 1. However, if we calculate the success rate per project proposal rather than per submission, around 11.5 % of Phase 2 and 16.6 % of Phase 1 proposals are ultimately successful.
Effectiveness of support in the SME Instrument phases80
Support provided by the SME-I should be timely and relevant and meet the needs of innovative SMEs.
Phase 1 provides useful support to SMEs but similar schemes already exist in some Member States81
According to interviewed stakeholders, Phase 1 and Phase 2 have effectively become two different programmes. Phase 1 helps companies with no public funding experience, such as small IT companies or start-ups; Phase 2 is more complex, which means the type of companies applying for Phase 1 find applying for Phase 2 a challenge.82
The difference in success rates between companies passing through Phase 1 before applying to Phase 2 and companies applying directly to Phase 2 has been narrowing throughout SME-I implementation. However, the Phase 2 success rate is still 50 % higher for companies passing through Phase 1 than for companies applying directly to Phase 2 (see Figure 10).
Phase 2 beneficiaries that had passed through Phase 1 indicated that the first phase had provided good preparation, helping them to improve the project.84
Stakeholders interviewed in some Member States believed that Phase 1 projects could often be carried out just as well at national level, although this would be a challenge in some Member States.85
In our survey of the NIAs, 48 % of respondents declared that their Member State had national programmes similar to Phase 1. When asked about the main strengths of SME-I Phase 1 compared with national programmes, the NIAs cited the fast and transparent selection procedure, the credibility conferred by the EU label, and access to coaching and business acceleration services. In addition, they praised the critical mass of innovative companies that had been set up thanks to SME-I Phase 1, which had managed to attract many innovative companies to the EU programme.86
When asked for their views on continuing Phase 1 under the new FWP, 86 % of NIA respondents considered that Phase 1 should be preserved under the new FWP (see Box 1 for examples of opinions of NIAs on whether to continue with funding for Phase 1). Those in favour of continuing Phase 1, indicated that the business acceleration and coaching services had increased these companies’ capacity to handle innovation activities in a professional way, allowing them to scale up and grow. They suggested that the European nature of the call for proposals spurred SMEs to raise their level of ambition from the early development stages, and that the simple and fast evaluation process had no equivalent at national level. Those against continuing Phase 1, (14 %) noted the absence of added value over national/regional instruments and the absence of a significant link between Phases 1 and 2.
National Innovation Agencies opinions on Phase 1
- “Phase 1 has been an excellent entry point to Horizon 2020 for SMEs with no prior experience of European or International programmes for R&I. The mentoring and coaching activities provided by EEN to SME I beneficiaries have increased these companies’ capacity to handle innovation activities in a professional way, allowing them to scale and grow.”
- “Phase 1 has enabled SMEs to take one step further. SMEs themselves often lack knowledge and resources to make exhaustive IP, market and competition surveys, etc. After finalisation of the Phase 1 project, they are also well prepared, not only to apply for Phase 2 funding but also for other funding resources/capital. The grant received from the EC is also kind of a trust and quality label.”
- “Phase 1 is valuable, but does not add the most benefit. Rather it is important that MSs/Associated Countries also invest themselves, so that small-scale interventions such as this could be left to national/regional agencies. However, not all MSs are equipped at present to deliver such support.”
- “Phase 1 provides no additionality; any MS can set up a similar programme.”
Phase 1 imposes an excessive burden on SME Instrument administration87
Since the launch of the SME-I, 3 978 Phase 1 grant agreements have been signed. The process from start to finish requires a considerable administrative effort in terms of evaluation, grant preparation, grant signature and coaching services. Four project officers manage around 1 000 projects per year. Project monitoring is therefore limited to administrative checks, without an assessment of the quality of the feasibility study.88
Table 1 compares the costs of remote evaluation per phase with the overall amount granted. It highlights a large difference in the costs of each phase, with the relative evaluation costs being ten times greater (per euro granted) in Phase 1 than in Phase 2. The benchmark for the cost of evaluation in the private venture capital sector is 3 %.
|PHASE 1||PHASE 2|
|Number of proposals evaluated||39 419||20 957|
|Number of proposals evaluated per day and evaluator||5||3|
|Remote evaluation cost per proposal||€360||€600|
|Total cost||€14 190 840||€12 574 200|
|Granted amount||€170 800 000||€1 760 609 479|
|Cost of evaluation / Granted amount||8.3 %||0.7 %|
Despite the greater administrative overhead incurred for Phase 1 compared to Phase 2, Phase 1 provides effective support, thanks to the fast selection process at EU level, the EU label for beneficiaries and the access to the BAS. In addition, it has attracted many innovative companies to the EU programme. However, in countries where similar programmes to Phase 1 already exist, its relevance is diminished.90
The Commission has discontinued Phase 1 from September 2019.
Phase 2 provides effective support to SMEs91
Interviewed stakeholders (representatives from the NIAs and NCPs, innovation experts, evaluators, jury members, the EEN, SME umbrella organisations and beneficiaries) were unanimous in their endorsement of Phase 2 on account of its many positive elements, such as:
- the intensity of financial support at a high technology readiness level that Member States cannot provide27;
- competition among SMEs at EU level;
- attraction of additional investment through association with the EU brand (see paragraphs 119 and 121);
- availability of coaching and business acceleration services;
- simple and fast selection and award processes compared to national schemes; and
- focus on the “go-to-market” strategy of the projects, in which projects develop an action plan specifying how the SME will reach customers and achieve competitive advantage.
In our survey to the NIAs, we asked whether they thought that SME-I Phase 2 should continue under Horizon Europe and why (see Box 2 for examples of opinions of NIAs on whether to continue with funding for Phase 2). All respondents said that it should continue.
National Innovation Agencies opinions on Phase 2
- It offers something different from what is available at the national level; in addition, it facilitates the creation of international networks. Coaching is also important.
- It is a great instrument that is easy to understand for the applicants.
- It is an important and unique programme to support growing SMEs in the pilot phase.
- The success and popularity of the scheme amongst SMEs has proved that it has a very suitable setup for SMEs. The changes made during the implementation period (especially interviews) have raised the value of the scheme.
When asked if significant changes should be made to the design of the SME‑I, 75 % replied “no”, 16 % indicated limited changes and only 11 % more profound changes. This suggests that Phase 2’s current form is generally well appreciated.94
Phase 2 of the SME-I provides effective support to beneficiaries. It provides EU branding that gives visibility to the companies and projects, helps them to raise additional investment, and allows access to the EU network of coaching and BAS. Phase 2 enjoys a very high appreciation in its current form among surveyed NIAs. This opinion is shared by all stakeholders interviewed.
Phase 3 business acceleration services have potential but were launched late95
The coaching and business acceleration services (Phase 3) play a key role in the overall setup of the SME-I, as they should respond to SMEs’ innovation needs through tailor-made support, competence development and networking. According to a study published by the University of Manchester, there is “a far greater level of success for firms (particularly small firms) in measures that combine direct and indirect support”28.96
Coaching covers a broad range of topics, notably: business development, organisational development, cooperation and financing. Phase 1 beneficiaries receive three days’ coaching and Phase 2 beneficiaries receive 12. The SME-I has led to the set-up of the first European network of coaches to support beneficiaries.97
Business acceleration services are open to both Phase 1 and Phase 2 beneficiaries and include participation in:
- trade fairs and conferences;
- corporate days;
- investors’ events;
- the EIC Innovators' summit;
- the EIC Community Platform;
- an investors' matching tool;
- the EIC Academy.
Phase 3 events and other business acceleration services have focused primarily on putting SMEs in contact with potential investors or business partners. EASME has done little to help beneficiaries in reaching out to potential customers (both large private corporates and public bodies through innovative public procurement).99
SME beneficiaries responding to our survey very much appreciated both the coaching scheme and any business acceleration services that they had used (see Figure 11). This positive opinion was confirmed by our visits to beneficiaries and the surveyed NIAs. Nevertheless, the NIAs and EEN nodes suggested that EASME could:
- better coordinate the organisation of events with local players (NIAs and EEN nodes);
- better target the marketing of business acceleration services to avoid emailing SMEs about events that were not relevant to them;
- explore opportunities to collaborate with national promotional institutions that could provide investment opportunities to SME-I beneficiaries.
Interviewed innovation experts take the view that business acceleration services should stimulate the demand-side through matching SMEs with potential large business customers and supporting their participation in innovative public procurement schemes.101
In comparison, Phase 3 of the SBIR programme is oriented towards public procurement. In the United States, federal agencies with annual R&D budgets exceeding $100 million are required to allocate 3.2 % to beneficiaries of the SBIR programme in the form of public procurement. In 2015, the contracts signed between US federal agencies and SBIR beneficiaries amounted to $1.3 billion, while grants overall were worth $1.2 billion29.102
The importance of public procurement for innovation for SMEs and start-ups is recognised by the Commission in its Guidance on Innovation Procurement30. In this document it indicates that “by acting as a lead customer, public buyers can provide innovative companies with an opportunity to test their new solutions under real-life conditions. Moreover, by becoming their customer and thus increasing their turnover, contracting authorities might encourage other investors – both public and private – to invest in their activities”. However, at present, the Commission has not included any innovative public procurement schemes among the business acceleration services to link the SME-I beneficiaries to EU agencies or national institutions.103
Uptake of the various business acceleration services has been low, with attendance among the surveyed beneficiaries ranging from 12 % at the EIC Academy to 40 % at trade fairs and conferences (see Figure 12). This is partly explained by the fact that some services only started at the end of 2017, almost four years after the launch of the instrument.
Effectiveness of the SME Instrument not assessed and its future role in Horizon Europe is still to be determined104
In order to provide timely input to the drafting of the new regulation, the Commission performed several evaluations in the early years of the SME-I – despite the lack of mature data (see Figure 13) – such as:
- the mid-term evaluation of the SME-I published in February 2017, by which point, no Phase 2 innovation project had yet been completed;
- the H2020 mid-term evaluation published in May 2017, affected by the same constraints as in the point above;
- the Horizon Europe Impact Assessment published in June 2018. Only around 200 companies had at this point completed their Phase 2 innovation projects. Furthermore, it normally takes a few years to see the real impact of the innovation project.
Due to the novelty of the programme and the absence of any previous track record, the SME-I was evaluated purely on the basis of inputs and completed Phase 1 projects, and not on the basis of results from Phase 2 projects. Consultations conducted and independent reports produced for the design of the EIC under Horizon Europe (see Annex II) were similarly affected. Therefore, the Commission could not base the design of the EIC under Horizon Europe on a comprehensive analysis of the SME-I’s implementation, achieved results and impact.
Attracting investment after SME Instrument funding106
One of the SME-I’s objectives is to facilitate access to private capital and create links to EU-backed financial instruments31. According to Council Decision 743/2013, “links to the financial instruments […] are foreseen, for example, by giving SMEs that have successfully completed phases 1 and/or 2, priority within a ring-fenced volume of financial resources”.
Commission has only limited knowledge of beneficiaries´ overall financing needs and has not made link to EU financial instruments107
EASME does not systematically collect information on Phase 2 beneficiaries’ additional financial needs for full development of their projects. EASME last carried out a survey in 2016 to assess these needs but posed no questions on the preferred source or intended use of funding.108
In 2018, DG RTD asked the EIB to produce a study on access to finance for SME‑I beneficiaries, which was then used to support the Horizon Europe Impact Assessment32. The EIB based the report on prior assessments and on a survey conducted on a sample of beneficiaries. However, the sample was not representative and only 24 beneficiaries responded to the survey. Consequently, the report provides only limited insight into the actual financial needs of SME-I beneficiaries.109
Our representative survey (see Annex I) provided some indication of the financial needs of Phase 2 beneficiaries. In particular:
- three quarters of respondents said they needed additional financing of an average of €7.1 million;
- 70 % of respondents seeking additional financing expressed an interest in private venture capital investment, while 48 % were open to debt instruments such as loans or credit lines.
The type of financing sought varies according to company maturity with young SMEs more interested in equity injections than older ones (see Figure 14).
The majority of SME-I beneficiaries would need additional financing to support their innovation endeavours and bring their innovation projects to market. However, the Commission’s knowledge of beneficiaries’ financial needs is limited.112
Under the 2014-2020 multiannual financial framework, the EU launched a large range of financial instruments to support innovation by SMEs33. However, 64 % of beneficiary survey respondents were not aware of these instruments.113
The EIB report on access to finance for beneficiaries of the SME-I34 drew the following conclusions, which were confirmed through our survey and interviews with beneficiaries:
- There is a funding gap for SME-I beneficiaries when projects exit Phase 2.
- Grants provide a positive market signal to private capital providers.
- Available information on financial instruments is fragmented and communication between private and public capital providers is limited.
An EAG report35 in 2016, pointed to the lack of synergies between different EU financial interventions and the need for the SME-I to coordinate with other public investors, to better meet projects’ demands for funds following Phase 2 completion.115
We analysed the list of beneficiaries of EU-backed venture capital managed by the EIB and the EIF and found that, by the end of 2018, only 16 SME-I beneficiaries (eight of which were Phase 2) had received such financial support. In five cases, the financial instrument’s investment occurred before the SME-I grant had been awarded.116
One of the SME-I’s aims since inception has been to create links with EU-backed financial instruments. However, the Commission has taken very little action to this end: it did not ring-fence any funds for SME-I beneficiaries and beneficiaries have limited awareness of the EU-backed financial instruments.
Beneficiaries attract further investment but levels vary across EU117
SME-I grant agreements do not impose reporting obligations on beneficiaries following completion of the project. Instead, EASME monitors beneficiaries’ evolution after finalisation of the SME-I grant through two database sources managed by external contractors:
- Source 1: is used to assess investment raised by SME-I beneficiaries. The database is populated through collecting information on investment rounds which is publicly available on-line. To assess the reliability of this source, we carried out checks on a random sample of 30 Phase 2 beneficiaries, which corroborated the figures obtained from information available on-line.
- Source 2: is used to assess the evolution over time of SME-I beneficiaries’ performance in terms of turnover, net income, cash flow and employment levels.
Information collected directly from beneficiaries may be less reliable due to self-reporting bias. In addition, the use of third-party information is more cost-efficient. At the same time, both sources of information used are incomplete, since:
- Source 1 underestimates the actual investment raised by SME-I beneficiaries, due to the unknown quantity of investment in the form of debt and equity injections that are not published on-line.
- Source 2 provides complete information for approximately only 60 % of all SME-I beneficiaries36.
According to the information available on-line, the investment-to-grant ratio is 2.9 for Phase 2 beneficiaries that received an SME-I grant in 2014 and 2015 and exited their innovation projects in 2017. Figure 15 shows the evolution in additional investment raised by beneficiaries in the years following the granting of SME-I support.
These figures do not include investment rounds that are not disclosed online, such as most of smaller equity injections and nearly all debt capital provided by banks, funds and other financial players. Investments raised by only 11 % of Phase 2 beneficiaries are publicly available on-line.121
In comparison, the majority of Phase 2 beneficiaries (78 % of respondents to our survey) declared that Phase 2 funding had helped them leverage further funding to support their innovation needs. Hence, beneficiaries’ actual capacity to attract investment is presumably higher than that inferred from information available on-line.122
According to third-party (source 1 see paragraph 117) information confirmed by data collected in project reporting, SME-I beneficiaries show positive trends in structural growth, with approximately 75 % of the companies having seen their operating revenue grow since applying for the grant and 67 % increasing their headcount.123
A comprehensive set of impact metrics based on reliable data, combined with complete automated profiling of the companies submitting project proposals and selected for a grant, is necessary to develop an effective business intelligence strategy. This could help:
- identify participation patterns and potential imbalances;
- link impact metrics with clusters of participants, providing valuable information on how to maximise the overall impact of the instrument.
The SME-I under the Enhanced EIC Pilot has introduced improvements in terms of company profiling, since the new administrative forms collect data on previous rounds of investment, financial data and ownership structure of the proposers. However, to date information has not been systematically collected at proposal submission stage on the gender of shareholders, which is one of the criteria assessed by jury members.125
Significant differences exist among participating countries, with Phase 2 beneficiaries in the north-west of Europe managing to raise more private resources than SMEs in the south and east (see Figure 16)37. Disparities between the venture capital markets in these countries partially explain such imbalances.
The results of our survey among beneficiaries suggest that geographic location is a determining factor affecting a company’s propensity to look for equity and/or debt investment. In particular, 84 % of respondents in the Nordic countries and the United Kingdom intend to look for equity injections, compared with 54 % in Spain and 42 % in Italy.127
The SME-I EAG raised the issue of cross-country variation and differing cultures in the use of market-based instruments and recommended mapping the European landscape “for a better knowledge of potential co-investors and to verify if cross-border operators are able to cover some financial gaps when national systems do not work. Platforms and specific events could help in this process”38.128
Picture 3 shows the flows of additional investments above €10 million to beneficiary countries, broken down by country of origin. Of the €1.8 billion in additional investment raised by Phase 2 beneficiaries (see paragraph 119), approximately €400 million comes from investors headquartered in the United States and €181 million from investors in China. The largest single investor in Phase 2 beneficiaries is based in the United States, and three of the five biggest investments (above €50 million) are from investors outside the EU.
Conclusions and recommendations129
We found that the SME Instrument provides effective support to SMEs in developing their innovation projects and that having the EU branding helps companies to attract additional investment. However, links have not been established with EU-backed financial instruments that could help beneficiaries scale-up and bring innovation projects to market. Both Phases 1 and 2 of the instrument provide effective support to SMEs, though Phase 1 incurs disproportionally high administrative costs. The instrument is competently managed by the Commission. The high number of resubmissions and the limited resources have hindered the selection procedure and development of the business acceleration services.130
All recommendations are applicable to the SME Instrument’s successor under Horizon Europe.
Targeting the right beneficiaries131
The instrument’s broad objectives and targets, together with the changes introduced during the course of its implementation, have caused uncertainty for stakeholders. The current profile of companies fits the academic model of firms with high growth potential but the instrument funds some SMEs that could have been financed by the market (see paragraphs 28 to 39).
Participation in the instrument varies markedly between countries, partly due to factors beyond the control of the Commission but also because of the varying levels of support provided by National Contact Points and the Enterprise Europe Network (see paragraph 43 to 45 and Figure 5). With a limited budget, the Commission organised events and communication activities, but its marketing and communication was neither structured nor sufficiently well-targeted to reach the right companies (see paragraphs 40 to 58).Recommendation 1 – Improving communication strategy and support to National Contact Points, in particular for those Member States with the lowest level of participation
The Commission should:
- focus better on marketing and communication strategy to raise awareness among SMEs targeted of the funding opportunities offered by the instrument and its successor under Horizon Europe,
- improve its support to National Contact Points for SMEs and the Enterprise Europe Network by promoting peer-learning projects and the exchange of best practice and ensuring that support to the network of National Contact Points for SMEs is operational at the beginning of the next framework programme.
Target implementation date: 2021
Selection of projects133
Improvements have been made to evaluation and selection procedures over the lifetime of the instrument, with the presentation to a jury being a particularly useful addition in identifying the best proposals whilst complying with the time-to-grant target (see paragraphs 65 to 69).134
There is variability in scores awarded in the remote evaluation, which can be partially explained by the limited resources and the high number of submissions. Evaluator training is well appreciated, with scope for further feedback at various levels. IT tools used are not fit for purpose, putting the evaluation process at risk (see paragraphs 61 to 64; 70 to 73).135
The resubmission of unsuccessful proposals is a large and increasing drain on management and evaluation resources, increasing the administrative costs. Moreover, it lowers the success rate thus discouraging participation (see paragraphs 74 to 79).Recommendation 2 – Improving the selection procedure
In order to optimise the use of resources and ensure an efficient selection of the best proposals, the Commission should refine the selection procedure in the following ways:
- provide remote evaluators with additional time to conduct their work;
- set up a two-way information channel between remote evaluators and jury members to allow the latter to access the remote evaluation and provide the former with feedback on the quality of their work;
- develop purpose-built IT tools to reliably manage the evaluation process;
- limit the number of times a proposal can be resubmitted, thereby freeing up resources which are currently used to re-perform evaluations of the same proposal in multiple successive cut-offs;
- In order to encourage the participation of more SMEs with excellent innovation projects, the Commission should publish the success rate per project proposal.
Target implementation date: 2021
Effectiveness of support in the SME Instrument phases136
Phase 1 provides effective support, thanks to the fast selection process, the EU label for beneficiaries and the access to the business acceleration services. In addition, it has attracted many innovative companies to the EU programme. However, it imposes an excessive burden on the Commission´s administration of the instrument and there are countries where similar programmes already exist (see paragraphs 81 to 89) Phase 1 was discontinued as from September 2019.137
Phase 2 of the SME-I provides effective support to beneficiaries and is highly appreciated by all stakeholders in its current form. It provides EU branding that gives visibility to the companies and projects, helps them to raise additional investment, and allows access to the EU network of coaching and business acceleration services (see paragraphs 91 to 94).Recommendation 3 – Replacing Phase 1 and building on Phase 2 support to SMEs
The Commission should:
- propose to the Member States that the Commission manage a scheme similar to Phase 1;
- provide beneficiaries of this scheme with access to coaching and Business Acceleration Services and an EU brand, and
- preserve a scheme similar to Phase 2 within the EIC under Horizon Europe, building on the results from the EIC Pilot.
Target implementation date: 2021138
Coaching and business acceleration services have the potential to amplify effects of the instrument but, having been launched late, are not sufficiently visible and only a small share of SMEs made use of the services. The resources allocated are limited and the services could be more tailor made and better target the demand side (see paragraphs 95 to 103).Recommendation 4 – Enhancing Business Acceleration Services
The Commission should enhance the business acceleration services by allocating appropriate resources to this area, to:
- deliver more tailor-made business acceleration services;
- increase awareness among beneficiaries employing a targeted communication approach and;
- better address the demand side establishing connections with large private customers and through public procurement for innovative projects.
Target implementation date: 2022
Attracting investment after SME Instrument funding139
The majority of SME-I beneficiaries still need additional financing to support their innovation endeavours and bring their innovation projects to market. However, the Commission has taken little action to create links with EU-backed financial instruments and has not explored collaboration opportunities with national promotional institutions. Moreover, beneficiaries are largely unaware of EU-backed financial instruments and the Commission’s knowledge of beneficiaries’ financial needs is limited. The 2018 EIB report on access to finance of beneficiaries confirmed that the available information on financial instruments is fragmented and communication between private and public capital providers is limited (see paragraphs 107 to 116).Recommendation 5 – Creating links with financial instruments
The Commission should:
- regularly collect information on the amount and type of funding needed by SME-I beneficiaries along the implementation of the innovation project;
- raise awareness among beneficiaries on the existence of different financial instruments at EU and national level and provide advice on those which would best fit their financial needs;
- identify and promote synergies with EU backed financial instruments in order to support SME-I beneficiaries in fund raising;
- collaborate with Member States and national promotional institutions to promote nationally-backed financial instruments that might meet the financial needs of the SME-I beneficiaries.
Target implementation date: 2022
This Report was adopted by Chamber IV, headed by Mr Alex Brenninkmeijer, Member of the Court of Auditors, in Luxembourg at its meeting of 10 December 2019.
For the Court of Auditors
Annex I – Methodology
- desk review of public documents and Commission internal documents such as legal bases, guidelines, impact assessments, evaluation and monitoring reports, proposals for legislative acts, communications, position papers and other relevant documents;
- analytical review of data from different sources: CORDA, Business Objects, Innovation Scoreboard, and web-crawling;
- online questionnaires sent in March 2019 to:
- 390 beneficiaries and unsuccessful applicants receiving Seal of Excellence selected on a random basis, with a 71 % response rate (88 % response rate for Phase 2 beneficiaries);
- 158 remote evaluators selected on a random basis, with a 96 % response rate;
- 32 NIAs or similar bodies with a 100 % response rate;
- information visits to ministries, innovations agencies, National Contact Points, EEN, beneficiaries and other relevant stakeholders in Bulgaria, Denmark, France, Romania, Slovenia, Spain and the United Kingdom;
- panel of independent experts in the field of innovation from different domains;
- interviews with different experts in the field of innovation linked to the SME-I such as jury members, members of the H2020 SME EAG, representatives of consulting firms;
- participation as observers in the presentation of projects to juries (second stage of Phase 2 selection process) and in a business acceleration services event;
- interviews with Commission staff from DG RTD, DG CONNECT, EASME and REA as well as with the EIB and the EIF.
Annex II – Statistics
Source: ECA based on EASME data.
Annex III – From the idea to the proposal of the EIC under Horizon Europe
- In June 2015, during the ERA Conference "A new start for Europe: Opening up to an ERA of Innovation", the Commission launched the idea of an EIC.
- The Commission launched a call for ideas in Spring 2016 in order to contribute to the design of the EIC Pilot. Through this public consultation, the Commission gathered “stakeholders' views on disruptive, market-creating innovation, on gaps in the current innovation support landscape and on the potential remit of an EIC”39.
- On 13 July 2016, the Commission organised a workshop with over 100 stakeholders from the private, research and public sectors to discuss the outcome of the call for ideas”40.
- In November 2016, the Commission launched the Start-up/Scale-up initiative, aiming to bring together under one umbrella a range of existing and new actions to support start-up companies and companies that want to scale-up their businesses41.
- The Commission set up the “EIC High Level Group of Innovators” (EIG HLG) in January 2017 with the mandate of providing support in developing the EIC. The group, made up of entrepreneurs, investors and innovation experts, met six times between March 2017 and December 2018 and produced a “Full set of key recommendations” in January 201842.
- The Commission presented a “Proposal for a Regulation of the European Parliament and of the Council establishing Horizon Europe” on the 7th of June 201843. An impact assessment accompanied the Proposal44.
Acronyms and abbreviations
BAS: Business and acceleration services
DG RTD: Commission’s Directorate-General for Research and Innovation
EAG: Small or Medium-sized Enterprises Expert Advisory group
EASME: Executive Agency for Small and Medium-sized Enterprises
EEN: Enterprise Europe Network
EIB: European Investment Bank
EIC: European Innovation Council
EIF: European Investment Fund
EIS: European Innovation Scoreboard
FWP: Framework work programme
GDP: Gross domestic product
H2020: Horizon 2020
IT: Information technology
MFF: Multiannual financial framework
NCP: National Contact Point
NIA: National Innovation Agency
R&D: Research and development
SBIR: Small Business Innovation Research programme (United States)
SME-I: EU instrument for Small and Medium-sized Enterprises
SMEs: Small and medium-sized enterprises
Associated country: A third country, which is party to an international agreement with the European Union. Associated countries to the Horizon 2020 Framework Programme participate under the same conditions as legal entities from the EU Member States.
Beneficiary: A natural or legal person receiving a grant or loan from the EU budget.
Blended finance: The combination of grants with loans or equity from public and private sources.
Breakthrough innovation: A product, service or process introducing novel technology or a new business model that results in a paradigm shift, generating significant competitive advantages.
Call for proposals: A document soliciting applications from potential beneficiaries, published by a public entity announcing its intention to finance projects that will meet the specified objectives.
Cut-off: The date by which proposals must be submitted for a particular round of funding.
Disruptive Innovation: A product, service or process that disrupts existing markets by displacing leading firms and technologies and applying a new set of values.
European Innovation Scoreboard: A comparative analysis of the innovation performance of EU Member States, other European countries and regional neighbours.
Financial instrument: Financial support from the EU budget in the form of equity or quasi-equity investments, loans or guarantees, or other risk-sharing instruments.
National Contact Point: A national entity established and financed by governments of the EU Member States or states associated with a research framework programme to provide in-country support and guidance to applicants and beneficiaries under Horizon 2020.
Participant Portal: the single online gateway for applicants and beneficiaries in Horizon 2020, for identifying funding opportunities, accessing documents and guidance, submitting proposals and for the paperless management of grants and expert contracts. See http://ec.europa.eu/research/participants/portal.
The ECA’s special reports set out the results of its audits of EU policies and programmes, or of management-related topics from specific budgetary areas. The ECA selects and designs these audit tasks to be of maximum impact by considering the risks to performance or compliance, the level of income or spending involved, forthcoming developments and political and public interest.
This performance audit was carried out by Audit Chamber IV Regulation of markets and competitive economy, headed by ECA Member
From left to right:
1 Impact Assessment of the 9th EU Framework Programme for Research and Innovation (a New Horizon for Europe).
2 The vital 6 per cent. How high-growth innovative businesses generate prosperity and jobs 2009 - NESTA (National Endowment for Science, Technology and the Arts).
3 Henrekson, M. & Johansson, D. 2010. Gazelles as job creators: a survey and interpretation of the evidence. Small Business Economics, 35, 227-244, p. 240.
4 Communication from the Commission, Europe 2020, A strategy for smart, sustainable and inclusive growth, COM(2010) 2020.
6 Regulation (EU) No 1291/2013 establishing H2020.
10 COM(2018) 435, Proposal for a Regulation establishing Horizon Europe, June 2018.
12 The concept of non-bankability is defined in the EIC frequent asked questions as an “inability to attract sufficient funding”.
13 For example, the provision of financial support to projects through equity finance, and the partial acceptance of the selection processes carried out in other calls or programmes.
14 Special reports on guarantees (SR 20/2017 SME Guarantee Facility) and on venture capital (SR 17/2019).
15 Regulation (EU) No 1291/2013 establishing H2020.
16 2014 Annual Report of the EAG on Innovation in SMEs.
18 Nesta Working Paper No 11/02, A look at business growth and contraction in Europe.
19 Regulation (EU) No 1291/2013 establishing H2020.
20 Recital (14) of Council Decision No 2013/743.
21 EU-13 Member States are meant as Bulgaria, Croatia, Cyprus, Czechia, Estonia, Hungary, Latvia, Lithuania, Malta, Poland, Romania, Slovakia, and Slovenia, whereas EU-15 countries are the other 15 Member States of the European Union.
23 “Evaluation of the SME instrument and the activities under Horizon 2020 Work Programme Innovation in SMEs”, February 2017.
25 Special report 28/2018 The majority of simplification measures brought into Horizon 2020 have made life easier for beneficiaries, but opportunities to improve still exist.
27 Commission Regulation No 651/2014 declaring certain categories of aid compatible with the internal market.
28 “The Impact of Direct Support to R&D and Innovation in Firms”, Compendium of Evidence on the Effectiveness of Innovation Policy Intervention, August 2012.
29 SBA Office of Investment & Innovation on SBIR, December 2016.
30 Commission notice C(2018) 3051, 15.5.2018.
31 Regulation (EU) No 1291/2013 establishing H2020.
32 EIB-Innovfin Advisory Group: “Improving Access to Finance for Beneficiaries of the SMEI” (March 2018).
33 Among others: “Access to risk finance initiative” (InnovFin) under H2020; “Access to finance for SMEs” (COSME); European Fund for Strategic Investments (EFSI).
34 EIB-Innovfin Advisory Group: “Improving Access to Finance for Beneficiaries of the SME-I” (March 2018).
35 H2020 EAG, Innovation in SMEs Annual Report 2016.
36 Source: EASME.
37 Source: ECA elaboration on EASME data. Countries for which no additional investment captured through web crawling technique do not appear in the chart.
38 H2020 EAG Innovation in SMEs, Consultation on the EU Strategic WP 2018-2020, June 2016.
39 Ideas for an EIC, Overview of Responses to the Call for Ideas, 2016.
40 Ideas for an EIC - Summary of a validation workshop with stakeholders held on 13 July 2016.
41 COM(2016) 733 final, Communication, “Europe's next leaders: the Start-up and Scale-up Initiative”, November 2016.
42 “Europe is back: Accelerating breakthrough innovation” EIC High-Level Group, January 2018.
43 COM(2018) 435 final, Proposal for a Regulation establishing Horizon Europe, June 2018.
44 SWD(2018) 307 final, Commission staff working document, Impact assessment, June 2018.
|Adoption of Audit Planning Memorandum (APM) / Start of audit||22.1.2019|
|Official sending of draft report to Commission (or other auditee)||6.11.2019|
|Adoption of the final report after the adversarial procedure||10.12.2019|
|Commission’s (or other auditee’s) official replies received in all languages||16.1.2020|
EUROPEAN COURT OF AUDITORS
12, rue Alcide De Gasperi
More information on the European Union is available on the internet (http://europa.eu).
Luxembourg: Publications Office of the European Union, 2020
|ISBN 978-92-847-4123-6||ISSN 1977-5679||doi:10.2865/077982||QJ-AB-19-025-EN-N|
|HTML||ISBN 978-92-847-4130-4||ISSN 1977-5679||doi:10.2865/77438||QJ-AB-19-025-EN-Q|
© European Union, 2020.
The reuse policy of the European Court of Auditors (ECA) is implemented by the Decision of the European Court of Auditors
Unless otherwise indicated (e.g. in individual copyright notices), the ECA’s content owned by the EU is licensed under the Creative Commons Attribution 4.0 International (CC BY 4.0) licence. This means that reuse is allowed, provided appropriate credit is given and changes are indicated. The reuser must not distort the original meaning or message of the documents. The ECA shall not be liable for any consequences of reuse.
You are required to clear additional rights if a specific content depicts identifiable private individuals, f. ex. as on pictures of the ECA’s staff or includes third-party works. Where permission is obtained, such permission shall cancel the above-mentioned general permission and shall clearly indicate any restrictions on use.
To use or reproduce content that is not owned by the EU, you may need to seek permission directly from the copyright holders. Software or documents covered by industrial property rights, such as patents, trade marks, registered designs, logos and names, are excluded from the ECA’s reuse policy and are not licensed to you.
The European Union’s family of institutional Web Sites, within the europa.eu domain, provides links to third-party sites. Since the ECA does not control them, you are encouraged to review their privacy policies.
Use of European Court of Auditors’ logo
The European Court of Auditors logo must not be used without the European Court of Auditors’ prior consent.
GETTING IN TOUCH WITH THE EU
All over the European Union there are hundreds of Europe Direct Information Centres. You can find the address of the centre nearest you at: https://europa.eu/european-union/contact_en
On the phone or by e-mail
Europe Direct is a service that your questions about the European Union. You can contact this service
- by freephone: 00 800 6 7 8 9 10 11 (certain operators may charge for these calls),
- at the following standard number: +32 22999696 or
- by electronic mail via: https://europa.eu/european-union/contact_en
FINDING INFORMATION ABOUT THE EU
Information about the European Union in all the official languages of the EU is available on the Europa website at: https://europa.eu/european-union/index_en
You can download or order free and priced EU publications at: https://op.europa.eu/en/web/general-publications/publications. Multiple copies of free publications may be obtained by contacting Europe Direct or your local information centre (see https://europa.eu/european-union/contact_en)
EU law and related documents
For access to legal information from the EU, including all EU law since 1952 in all the official language versions, go to EUR-Lex at: http://eur-lex.europa.eu/homepage.html?locale=en
Open data from the EU
The EU Open Data Portal (http://data.europa.eu/euodp/en/data) provides access to datasets from the EU. Data can be downloaded and reused for free, both for commercial and non-commercial purposes.