Assessment methodologies for General Purpose AI capabilities and risks (RIA) (AI/Data/Robotics Partnership)
Programme Category
Programme Name
Programme Description
Horizon Europe is the European Union (EU) funding programme for the period 2021 – 2027, which targets the sectors of research and innovation. The programme’s budget is around € 95.5 billion, of which € 5.4 billion is from NextGenerationEU to stimulate recovery and strengthen the EU’s resilience in the future, and € 4.5 billion is additional aid.
Identifier Code
Call
Summary
The rapid advancement of artificial intelligence (AI) has led to the development of increasingly sophisticated general-purpose AI (GPAI) models and systems. These models, such as large language models and multimodal AI systems, demonstrate remarkable capabilities across a wide range of tasks. However, assessing the capabilities of these models remains a significant challenge. Traditional evaluation methods often fail to capture the full spectrum of abilities exhibited by GPAI models and systems. Therefore, there is a pressing need for the development of new assessment frameworks, methodologies and tools that can comprehensively evaluate these models in terms of their trustworthy and ethical behaviour and operation, ensuring their reliability, fairness, and alignment with human values.
Detailed Call Description
This topic aims to develop robust assessment tools, techniques, and benchmarks specifically designed to rigorously evaluate GPAI models and systems, including multimodal systems. Proposals should cover one or more of the following research areas:
- Innovative methods for proactively identifying and forecasting emergent capabilities in GPAI models and systems. This encompasses the identification of capabilities with both beneficial and potentially detrimental uses.
- Assessment of GPAI capabilities with a significant economic impact or potential for misuse. This includes assessing capabilities that drive beneficial innovation and societal good, as well as evaluating potential risks in areas such as chemical, biological, radiological, and nuclear (CBRN) hazards or cybersecurity threats.
- Developing assessment techniques that illuminate the underlying mechanisms of emergent capabilities in AI systems, emphasising interpretability and explainability.
Projects should generate example benchmark tests to examine trained AI models, systematically uncovering latent capabilities. These benchmarks will be made available to GPAI providers, policymakers, and other relevant stakeholders to implement robust evaluation tools.
Call Total Budget
Financing percentage by EU or other bodies / Level of Subsidy or Loan
100%
Expected EU contribution per project: between €3.00 and €4.00 million.
Thematic Categories
- Information and Communication Technologies
- Information Technology
- Research, Technological Development and Innovation
Eligibility for Participation
- Businesses
- Educational Institutions
- Large Enterprises
- Legal Entities
- NGOs
- Other Beneficiaries
- Private Bodies
- Researchers/Research Centers/Institutions
- Semi-governmental organisations
- Small and Medium Enterprises (SMEs)
- State-owned Enterprises
Eligibility For Participation Notes
A number of non-EU/non-Associated Countries that are not automatically eligible for funding have made specific provisions for making funding available for their participants in Horizon Europe projects.
Participation is limited to legal entities established in Member States, Iceland and Norway and the following additional associated countries: Canada, Israel, the Republic of Korea, New Zealand, Switzerland, and the United Kingdom.
Entities established in an eligible country listed above, but which are directly or indirectly controlled by a non eligible country or by a non-eligible country entity, may not participate in the action unless it can be demonstrated, by means of guarantees positively assessed by their eligible country of establishment, that their participation to the action would not negatively impact the Union’s strategic assets, interests, autonomy, or security. Entities assessed as high risk suppliers of mobile network communication equipment within the meaning of ‘restrictions for the protection of European communication networks’ (or entities fully or partially owned or controlled by a high-risk supplier) cannot submit guarantees.
Call Opening Date
Call Closing Date
National Contact Point(s)
Research and Innovation Foundation
29a Andrea Michalakopoulou, 1075 Nicosia,
P.B. 23422, 1683 Nicosia
Telephone: +357 22205000
Fax: +357 22205001
Email: support@research.org.cy
Website: https://www.research.org.cy/en/
Persons to Contact:
Dr Angelos Ntantos
Scientific Officer
Email: antantos@research.org.cy
Mr. George Christou
Scientific Officer
Email: gchristou@research.org.cy