Skip to main content
← All posts·
EU AI Act

General-Purpose AI Under the AI Act: Infrastructure for GPAI Model Compliance

The AI Act creates specific obligations for general-purpose AI models (GPT, Llama, Mistral). Here's the infrastructure for GPAI transparency, copyright, and systemic risk management.

Luca Berton8 min read

Chapter V of the AI Act creates specific obligations for general-purpose AI (GPAI) models — what the industry calls foundation models or large language models. If you develop, fine-tune, or deploy GPAI models, you have infrastructure obligations effective August 2025.

GPAI Provider Obligations (All GPAI)

  • Technical documentation — Training methodology, data sources, compute used, evaluation results
  • Information for downstream providers — Capabilities, limitations, intended use, integration guidance
  • Copyright compliance policy — Machine-readable opt-out mechanism (robots.txt/TDM reservation)
  • Training data summary — Detailed enough to identify sources, not necessarily full dataset disclosure

Systemic Risk GPAI (Additional Obligations)

GPAI models with systemic risk (trained with >10^25 FLOPs, or designated by Commission) face additional requirements:

  • Model evaluation — Standardized benchmarks including adversarial testing
  • Systemic risk assessment and mitigation — Infrastructure for identifying and addressing risks at scale
  • Incident monitoring and reporting — Track and report serious incidents to the AI Office
  • Cybersecurity protection — Adequate security for the model and its infrastructure
📘 Book

Kubernetes Recipes

A practical guide for container orchestration and deployment by Grzegorz Stencel & Luca Berton (Apress).

Watch on Skillshare →

Infrastructure for GPAI Compliance

Training Documentation Pipeline

Automated capture during training: hyperparameters, hardware configuration, training duration, dataset composition, evaluation benchmarks, known failure modes. This should flow from your training pipeline, not be compiled manually.

Web crawling for training data must respect TDM opt-outs. Infrastructure: robots.txt parser, TDM reservation header detection, automated filtering of opted-out content, audit trail of crawling decisions.

Downstream Provider Interface

If you serve GPAI models to other businesses (API or self-hosted), provide infrastructure for: model cards with capabilities and limitations, acceptable use policies enforced at the API level, safety evaluation results accessible to downstream integrators.

Fine-Tuning and Deployment

If you fine-tune a GPAI model and deploy it as a high-risk AI system, you inherit both GPAI and high-risk obligations. Your infrastructure must cover the full stack: GPAI transparency + high-risk governance. Build once, comply with both.

🎓 Course with Starweaver

Operationalizing ML Models: MLOps for Scalable AI

Turn ML prototypes into robust, scalable systems using real-world tools. In collaboration with Starweaver.

Start on Coursera →
ai act
gpai
foundation models
llm
systemic risk

Need help applying this in your organization?

Get a free 30-minute assessment with actionable recommendations — whether we work together or not.

Book Your Free AI Platform Assessment

Or see AI readiness assessment scope & pricing

18+ years experience · Ex-Red Hat & Dell · Speaker at KubeCon EU 2026

Luca Berton

Written by

Luca Berton

CEO at Open Empower. 18+ years building enterprise infrastructure at JPMorgan Chase, Red Hat & Dell. Author of 9 technical books. Speaker at Red Hat Summit and KubeCon EU 2026. Instructor on Coursera, Pluralsight & Udemy.

Get more insights like this

Practical AI infrastructure and platform engineering guides — delivered to your inbox.

Subscribe to Newsletter →