Nuance DAX and the EU AI Act: healthcare AI compliance in full
Why DAX is high-risk: the Annex III Category 5 classification
EU AI Act Annex III Category 5 covers "AI systems intended to be used by or on behalf of healthcare professionals for providing medical advice, supporting medical diagnosis or the selection of suitable treatments." Nuance DAX (Dragon Ambient eXperience) listens to patient-clinician conversations in real time and automatically generates structured clinical documentation — SOAP notes, consultation summaries, referral letters, and clinical coding recommendations. This is AI directly supporting healthcare delivery and clinical documentation that becomes part of the official patient record. The Annex III Category 5 classification is unambiguous.
What makes healthcare AI different from other high-risk categories
Healthcare AI carries a higher harm potential than most other Annex III categories because errors can directly affect patient safety. A clinical note that incorrectly documents a medication dose, a missed allergy, or an erroneous diagnosis can have life-threatening consequences. This is why the EU AI Act places healthcare AI firmly in the high-risk tier with the most extensive deployer obligations.
Microsoft and Nuance, as the providers of DAX, have significant conformity obligations — including clinical validation studies, accuracy documentation, and CE-marking equivalent processes. Your obligations as a deploying healthcare organisation build on this: ensuring the tool is used correctly, that clinicians maintain meaningful oversight, and that patients are informed.
Patient transparency: the ethical and legal obligation
Informing patients that an AI ambient listening system is active during their consultation is both an EU AI Act obligation (Article 26(6) — informing affected persons about high-risk AI use) and a GDPR obligation (Article 13 — informing data subjects about processing at the point of data collection). In practice, this means: a verbal statement at the start of each consultation ("I use an AI tool that listens to our conversation to help with my notes"), written information in patient intake materials, and clear signage in consultation rooms where DAX is deployed.
Patient consent — as opposed to notice — may also be required in some EU jurisdictions under national healthcare law, particularly for processing of special category health data. Consult your legal team and DPO on the consent requirements applicable in your jurisdiction.
Clinical staff training: beyond technical onboarding
Article 26(4) requires deployers to ensure "sufficient AI literacy and competence" among staff using high-risk AI systems. For DAX, this goes beyond the technical training provided by Microsoft/Nuance. Clinical staff need to understand: what types of errors DAX is prone to (background noise, overlapping speakers, uncommon drug names, dialects), how to critically review AI-generated notes rather than accepting them by default, how to correct and override AI documentation, and how to report suspected DAX errors through your organisation's clinical incident process.