ARTIFICIAL INTELLIGENCE ACT: TECHNICAL ASSISTANCE FOR AI SAFETY

Regulation (EU) 2024/1689 (Artificial Intelligence Act), which has entered into force on the 1st of August 2024, and for which certain rules will become applicable on the 2nd of August 2025 establishes a comprehensive legal framework governing the area of Artificial Intelligence, and in particular relevance to this procurement, establishes …

CPV: 79419000 Servizi di consulenza di valutazione
Luogo di esecuzione:
ARTIFICIAL INTELLIGENCE ACT: TECHNICAL ASSISTANCE FOR AI SAFETY
Ente di assegnazione:
European Commission, DG CNECT - Communications Networks, Content and Technology
Numero di premio:
EC-CNECT/2025/OP/0032-PIN

1. Buyer

1.1 Buyer

Official name : European Commission, DG CNECT - Communications Networks, Content and Technology
Legal type of the buyer : EU institution, body or agency
Activity of the contracting authority : General public services

2. Procedure

2.1 Procedure

Title : ARTIFICIAL INTELLIGENCE ACT: TECHNICAL ASSISTANCE FOR AI SAFETY
Description : Regulation (EU) 2024/1689 (Artificial Intelligence Act), which has entered into force on the 1st of August 2024, and for which certain rules will become applicable on the 2nd of August 2025 establishes a comprehensive legal framework governing the area of Artificial Intelligence, and in particular relevance to this procurement, establishes responsibilities for providers of General-Purpose Artificial Intelligence (GPAI) models, aiming to ensure transparency, safety, and accountability in the deployment and use of AI technologies. Articles 89 and 92 of the AI Act respectively allow the AI Office to monitor the compliance with regards to the AI Act and perform evaluations of GPAI models to assess the compliance and investigate systemic risks at Union level. Article 93 of the AI Act allows the Commission to request providers to take appropriate measures to comply with the obligations, to implement mitigation measures, or to restrict the availability of the model. In order to carry out these enforcement tasks in relation the AI Act, the AI Office is seeking support of suitable third-party contractors to provide technical assistance aimed at supporting the monitoring of compliance, in particular in its assessment of risks posed by GPAI models at Union level. This tender has been split into six lots. Five of those lots dedicated to specific systemic risks, namely (i) CBRN risks, (ii) cyber offence risks, (iii) loss of control risks, (iv) harmful manipulation risks and (v) sociotechnical risks. These lots all share a similar tasks and services: • The organisation of multiple risk modelling workshops together with the AI Office, producing a risk model, risk scenarios, as well as corresponding thresholds, informing further work on evaluations. • The development of newly evaluation tools that are private to the Commission. • The onboarding of existing evaluations that are publicly available into the developed risk framework. • The creation of a reference procedure and reporting template for doing risk assessment with respect to the developed evaluations. • Ad hoc and on demand services for complex evaluations, including for example red-teaming and uplift studies. • A risk monitoring service in the form of regular briefings on new developments (e.g. models, risk sources, elicitation techniques, mitigation, incidents) to complement existing AI Office monitoring actions. The scope of these tasks varies by lot. Furthermore, there is one lot that is cross-cutting across various risk. • Lot 6: agentic evaluation interface, procuring software, Cloud infrastructure support, and methodology to evaluate GPAI on diverse types of benchmarks, focusing on agentic interaction and complex agentic benchmarks.
Internal identifier : EC-CNECT/2025/OP/0032-PIN

2.1.1 Purpose

Main nature of the contract : Services
Main classification ( cpv ): 79419000 Evaluation consultancy services

2.1.3 Value

Estimated value excluding VAT : 9 080 000 Euro

2.1.4 General information

Additional information : This prior information notice announces the intention of the contracting authority to publish a future call for tenders. No other information or documents are available at this stage. Interested economic operators are invited to subscribe at the link https://ec.europa.eu/info/funding-tenders/opportunities/portal/screen/opportunities/tender-details/76f9edf2-d9e2-4db2-931e-a72c5ab356d2-PIN in order to get notified when the contract notice and all the procurement documents, including the tender specifications, are published.
Legal basis :
Regulation (EU, Euratom) 2018/1046

3. Part

3.1 Part technical ID : PAR-0001

Title : CBRN Risk Modelling and Evaluation
Description : The objective of this lot is to support the AI Office in its enforcement of the AI Act in relation to General-Purpose AI Models (GPAI) and General-Purpose AI Models with systemic risk (GPAISR), specifically where such models may pose risks of enabling chemical, biological, radiological, and nuclear attacks or accidents. This includes significantly lowering the barriers to entry for malicious actors, or increasing the potential impact achieved, in the design, development, acquisition, and use of such weapon. The AI Office seeks to improve its capacity in identifying, monitoring, and assessing these risks, including the capacity to measure relevant capabilities of GPAI models and assess the effectiveness of mitigations aimed at preventing malicious actors from gaining access to these capabilities. This lot aims to allow for flexible and close collaboration in developing risk models, prioritising risk scenarios, setting risk levels including a level of unacceptable systemic risk at Union level, identifying key model capabilities that could be linked to risk levels, and tailoring both new and existing risk measurement instruments to the context of the AI Office. Flexible collaboration between the AI Office and the contractor will be needed to ensure robust risk assessment as risks and our understanding of them evolve.

3.1.1 Purpose

Main nature of the contract : Services
Main classification ( cpv ): 79419000 Evaluation consultancy services

3.1.3 Duration

Duration : 36 Month

3.1.4 Value

Estimated value excluding VAT : 1 800 000 Euro

3.1.5 General information

The procurement is covered by the Government Procurement Agreement (GPA) : yes

3.1.6 Procurement documents

3.1.8 Techniques

Framework agreement :
No framework agreement

3.1.9 Further information, mediation and review

Review organisation : Court of Justice of the European Union -

3.1 Part technical ID : PAR-0002

Title : Cyber Offence Risk Modelling and Evaluation
Description : The objective of this lot is to support the AI Office in its enforcement of the AI Act in relation to General-Purpose AI Models (GPAI) and General-Purpose AI Models with systemic risk (GPAISR), specifically where such models may pose risks related to offensive cyber capabilities that could enable large-scale or sophisticated cyber-attacks, including on critical systems (e.g. critical infrastructure). This includes automated vulnerability discovery, exploit generation, operational use, and attack scaling. The AI Office seeks to improve its capacity in identifying, monitoring, and assessing these risks, including the capacity to measure relevant capabilities of GPAI models and assess the effectiveness of mitigations aimed at preventing malicious actors from gaining access to these capabilities. This lot aims to allow for flexible and close collaboration in developing risk models, prioritising risk scenarios, setting risk levels including a level of unacceptable systemic risk at Union level, identifying key model capabilities that could be linked to risk levels, and tailoring both new and existing risk measurement instruments to the context of the AI Office. Flexible collaboration between the AI Office and the contractor will be needed to ensure robust risk assessment as risks and our understanding of them evolve.

3.1.1 Purpose

Main nature of the contract : Services
Main classification ( cpv ): 79419000 Evaluation consultancy services

3.1.3 Duration

Duration : 36 Month

3.1.4 Value

Estimated value excluding VAT : 2 000 000 Euro

3.1.5 General information

The procurement is covered by the Government Procurement Agreement (GPA) : yes

3.1.6 Procurement documents

3.1.8 Techniques

Framework agreement :
No framework agreement

3.1.9 Further information, mediation and review

Review organisation : Court of Justice of the European Union -

3.1 Part technical ID : PAR-0003

Title : Loss of Control Risk Modelling and Evaluation
Description : The objective of this lot is to support the AI Office in its enforcement of the AI Act in relation to General-Purpose AI Models (GPAI) and General-Purpose AI Models with systemic risk (GPAISR), specifically with regards to risks related to the inability to oversee and control autonomous GPAISRs that may result in large-scale safety or security threats. This includes model capabilities and propensities related to autonomy, alignment with human intent or values, self-reasoning, self-replication, self-improvement, evading human oversight, deception, or resistance to goal modification. It further includes model capabilities of conducting autonomous AI research and development that could lead to the unpredictable emergence of GPAISRs without adequate risk mitigations. The AI Office seeks to improve its capacity in identifying, monitoring, and assessing these risks, including the capacity to measure relevant capabilities and propensities of GPAI models and assess the effectiveness of mitigations. This lot aims to allow for flexible and close collaboration in developing risk models, prioritising risk scenarios, setting risk levels including a level of unacceptable systemic risk at Union level, identifying key model capabilities that could be linked to risk levels, and tailoring both new and existing risk measurement instruments to the context of the AI Office. Flexible collaboration between the AI Office and the contractor will be needed to ensure robust risk assessment as risks and our understanding of them evolve.

3.1.1 Purpose

Main nature of the contract : Services
Main classification ( cpv ): 79419000 Evaluation consultancy services

3.1.3 Duration

Duration : 36 Month

3.1.4 Value

Estimated value excluding VAT : 1 800 000 Euro

3.1.5 General information

The procurement is covered by the Government Procurement Agreement (GPA) : yes

3.1.6 Procurement documents

3.1.8 Techniques

Framework agreement :
No framework agreement

3.1.9 Further information, mediation and review

Review organisation : Court of Justice of the European Union -

3.1 Part technical ID : PAR-0004

Title : Harmful Manipulation Risk Modelling and Evaluation
Description : The objective of this lot is to support the AI Office in its enforcement of the AI Act in relation to General-Purpose AI Models (GPAI) and General-Purpose AI Models with systemic risk (GPAISR), specifically where such models may pose risks of enabling the targeted distortion of the behaviour of persons, in particular through multi-turn interactions, that causes them to take a decision that they would not have otherwise taken, in a manner that causes, or is reasonably likely to cause, significant harm on a large scale. This includes the capability to manipulate through multi-turn interaction and the propensity of models to manipulate, including manipulation of high-stakes decision makers, large-scale fraud, or exploitation of people based on protected characteristics. As a guide, risk of harmful manipulation exists if it cannot, without reasonable doubt, be ruled out that a GPAISR, when integrated into an AI system, enables the AI system, irrespective of the intention of the AI system provider or deployer, to deploy subliminal, purposefully manipulative, or deceptive techniques as outlined in the Commission Guidelines on prohibited artificial intelligence practices established by Regulation (EU) 2024/1689 (AI Act) ( ). The AI Office seeks to improve its capacity in identifying, monitoring, and assessing these risks, including the capacity to measure relevant capabilities of GPAI models and assess the effectiveness of mitigations aimed at preventing malicious actors from gaining access to these capabilities. This lot aims to allow for flexible and close collaboration in developing risk models, prioritising risk scenarios, setting risk levels including a level of unacceptable systemic risk at Union level, identifying key model capabilities that could be linked to risk levels, and tailoring both new and existing risk measurement instruments to the context of the AI Office. Flexible collaboration between the AI Office and the contractor will be needed to ensure robust risk assessment as risks and our understanding of them evolve.

3.1.1 Purpose

Main nature of the contract : Services
Main classification ( cpv ): 79419000 Evaluation consultancy services

3.1.3 Duration

Duration : 36 Month

3.1.4 Value

Estimated value excluding VAT : 1 200 000 Euro

3.1.5 General information

The procurement is covered by the Government Procurement Agreement (GPA) : yes

3.1.6 Procurement documents

3.1.8 Techniques

Framework agreement :
No framework agreement

3.1.9 Further information, mediation and review

Review organisation : Court of Justice of the European Union -

3.1 Part technical ID : PAR-0005

Title : Sociotechnical Risk Modelling and Evaluation
Description : The objective of this lot is to support the AI Office in its enforcement of the AI Act in relation to General-Purpose AI Models (GPAI) and General-Purpose AI Models with systemic risk (GPAISR), specifically where such models may pose large-scale sociotechnical risks, including those risks stemming from harmful bias or discrimination, or from the endangering of fundamental human rights such as freedom of expression or health protection—irrespective of the downstream systems and contexts in which these models are deployed. The AI Office aims to enhance its ability to identify, monitor, and evaluate these risks, including the capacity to measure relevant capabilities and propensities of GPAI models and asses the effectiveness of mitigations. This includes the monitoring of indicator variables and the creation of early warning indicators for tracking accumulative risks that materialize through reach, well-meaning behaviour, and adoption rather than through novel capabilities or malicious actors. This lot aims to allow for flexible and close collaboration in developing risk models, prioritising risk scenarios, setting risk levels including a level of unacceptable systemic risk at Union level, identifying key model capabilities that could be linked to risk levels, and tailoring both new and existing risk measurement instruments to the context of the AI Office. Flexible collaboration between the AI Office and the contractor will be needed to ensure robust risk assessment as risks and our understanding of them evolve.

3.1.1 Purpose

Main nature of the contract : Services
Main classification ( cpv ): 79419000 Evaluation consultancy services

3.1.3 Duration

Duration : 36 Month

3.1.4 Value

Estimated value excluding VAT : 1 200 000 Euro

3.1.5 General information

The procurement is covered by the Government Procurement Agreement (GPA) : yes

3.1.6 Procurement documents

3.1.8 Techniques

Framework agreement :
No framework agreement

3.1.9 Further information, mediation and review

Review organisation : Court of Justice of the European Union -

3.1 Part technical ID : PAR-0006

Title : Agentic Evaluation Interface
Description : The objective of this lot is to supply the AI Office with a programmatic interface for the evaluation of General-Purpose Artificial Intelligence (GPAI) models through agentic interaction patterns, i.e. the evaluation of GPAI models for use in tasks requiring multiple decisions and interaction with digital environments such as a browser, command line, or a full operating system. The interface is taken to mean software, methodology, configuration, cloud orchestration and other digital technical components that would allow the AI Office to execute evaluations of GPAI model and their agentic capabilities, without further dependency on the contractor, supplementing and working in tandem with AI Office digital infrastructure. The AI Office is seeking such an interface in the form of a GPAI model evaluation workflow or ‘harness’, and the necessary components thereof, that allow the AI Office and its technical experts to rapidly integrate into the evaluation pipeline new GPAI models and benchmarks across all digital modalities (text, image, video, audio) and from the full spectrum of digital tasks. This harness should provide support for relevant and state of the art elicitation methods and agent scaffolding, including fallback mechanisms that connect text only models to multi-modal benchmarks. It is expected that a significant part of the service will be dedicated to supporting the AI Office in the deployment on Commission infrastructure of existing or developed components of the evaluation interface. Given the fast pace of development in AI, contractors should prepare for significant flexibility in execution and should structure the project to facilitate close communication for creating short feedback cycles and the purpose of alignment on design and needs.

3.1.1 Purpose

Main nature of the contract : Services
Main classification ( cpv ): 79419000 Evaluation consultancy services

3.1.3 Duration

Duration : 24 Month

3.1.4 Value

Estimated value excluding VAT : 1 080 000 Euro

3.1.5 General information

The procurement is covered by the Government Procurement Agreement (GPA) : yes

3.1.6 Procurement documents

3.1.8 Techniques

Framework agreement :
No framework agreement

3.1.9 Further information, mediation and review

Review organisation : Court of Justice of the European Union -

8. Organisations

8.1 ORG-0001

Official name : European Commission, DG CNECT - Communications Networks, Content and Technology
Registration number : COM
Department : CNECT.A - Artificial Intelligence Office,CNECT.A.3 - Artificial Intelligence Safety
Postal address : Rue de la Loi 200, Wetstraat 200
Town : Brussels
Postcode : B-1049
Country subdivision (NUTS) : Arr. de Bruxelles-Capitale/Arr. Brussel-Hoofdstad ( BE100 )
Country : Belgium
Telephone : +32 2 299 11 11
Roles of this organisation :
Buyer

8.1 ORG-0002

Official name : Court of Justice of the European Union
Registration number : CURIA
Postal address : Rue du Fort Niedergrünewald
Town : Luxembourg
Postcode : L-2925
Country subdivision (NUTS) : Luxembourg ( LU000 )
Country : Luxembourg
Telephone : +352 4303-1
Internet address : http://curia.europa.eu
Roles of this organisation :
Review organisation

8.1 ORG-0003

Official name : European Commission
Registration number : EUCOM
Postal address : Mondrian (CDMA), Rue du Champ de Mars 21
Town : Brussels
Postcode : B-1050
Country subdivision (NUTS) : Arr. de Bruxelles-Capitale/Arr. Brussel-Hoofdstad ( BE100 )
Country : Belgium
Telephone : +32 2 299 11 11
Roles of this organisation :
TED eSender
Notice information
Notice identifier/version : ef4feebd-b729-4ef2-8e34-9a612196fcb9 - 01
Form type : Planning
Notice type : Prior information notice or a periodic indicative notice used only for information
Notice dispatch date : 24/04/2025 17:35 +02:00
Languages in which this notice is officially available : English
Notice publication number : 00272332-2025
OJ S issue number : 82/2025
Publication date : 28/04/2025
Estimated date of publication of a contract notice within this procedure : 27/05/2025