IRT SystemX, a driving force for responsible AI to transform the industry of tomorrow

Discover

The Artificial Intelligence (AI) market is being driven by several key trends: the rise of generative AI and its application to numerous industrial and service-oriented use cases; the hybridization of traditional engineering tools with AI models; and the emergence of more sophisticated features made possible, in particular, by foundation models. These advances are expanding the functional scope of systems and raising expectations in terms of performance, versatility, and value creation. Industries are seeking to harness these opportunities to boost productivity and enhance the added value of their products, processes, and services. However, they face two major challenges: transitioning from demonstrators to operational deployment, and adapting quickly to the constantly evolving scientific and regulatory state of the art.

We are convinced that the true value of AI lies not in the models themselves, but in their level of acceptability and their ability to be effectively integrated into systems. That is why trust is at the heart of our work—we believe it is the key to unlocking AI’s full innovation potential for our industries.

For over ten years, we have been leading multi-partner, cross-sector R&T projects—such as Confiance.ai, a flagship program of the national AI strategy—to deliver tailored, by-design solutions to our partners

An approach focused on industrial AI needs

Responsible, industrial AI is at the core of IRT SystemX’s positioning. For AI to gain traction in strategic industrial sectors such as aerospace, automotive, energy, and defense, it must offer strong guarantees in terms of safety, security, and ethics. This is especially true for so-called critical systems, where there is no room for error.

Integrating AI into industrial systems is a major challenge. On the one hand, it requires an end-to-end approach to specify, design, assess, and operate these systems reliably throughout their entire lifecycle. On the other hand, companies must ensure that their AI-enabled systems comply with European regulations, including the AI Act.

To meet these needs, we ensure a high level of trust in the systems we develop, integrating principles of robustness, explainability, and uncertainty quantification. As part of the Confiance.ai program, SystemX, in collaboration with nearly 50 leading partners, has established the state of the art in Trustworthy AI engineering: a proven end-to-end methodology, validated through industrial use cases, along with a catalog of trust-enabling tools available to scientific and industrial communities. These resources foster the secure, regulation-compliant design of industrial applications that incorporate trustworthy AI components.

Through this program, IRT SystemX has become a key player in Trustworthy AI within the French and European ecosystems. Thanks to its expertise and network, the institute now stands as a true innovation and transformation driver, promoting the emergence of responsible industrial AI. It has also played a critical role in the development of European standards and norms for evaluating and certifying AI components.

2030 strategy: deepen, sustain, industrialize

To ensure the long-term impact of the Confiance.ai program, IRT SystemX is implementing a three-pronged strategy:

  • Deepen the results achieved by tackling challenges linked to new forms of AI, such as Large Language Models (LLMs), generative AI, hybrid approaches combining AI with physical or human knowledge, and cybersecurity concerns through new R&D projects.
  • Sustain and disseminate the methods and tools developed by launching the European Trustworthy AI Association, which aims to become a driving force for the EU’s industrial and responsible AI strategy.
  • Industrialize Trustworthy AI by guiding stakeholders toward solutions delivered by a network of experts and service providers tailored to their needs—be it training (e.g., a specialized master’s in Trustworthy AI), compliance support, or tools for deploying trustworthy AI in industry.

Open source as a catalyst for AI adoption

IRT SystemX’s strategy includes a commitment to open source, aimed at maximizing the impact of its work and encouraging the widest possible adoption—across Europe and globally—of its end-to-end methodology and tool catalog. This open approach enhances transparency, fosters collaboration, and enables a wide range of stakeholders to test, adopt, and improve the solutions.

By sharing its technological developments, SystemX aspires to become a central player in the dissemination of best practices and standards for Trustworthy AI, while also maintaining and expanding a strong national and international community of excellence.

Towards international engagement

Beyond establishing scientific and technological collaborations with international stakeholders, the institute is actively involved in standardization committees (e.g., ISO, CEN CENELEC, and AFNOR), as well as the AI Trust Alliance, to contribute to the development of global AI standards. Through these efforts, the institute reaffirms its commitment to playing a leading role in the global digital transformation of industry.

 

 

 

Digital security and networks