New requirements for regulating the use of artificial intelligence went into force in the European Union on Sunday with the implementation of the EU AI Act.
The act bans the use of AI programmes that exploit human vulnerabilities, such as the use of subliminal techniques and social scoring for public and private purposes, as used in China to reward or punish individuals for their behaviour.
“The uptake of AI systems has a strong potential to bring societal benefits, economic growth and enhance EU innovation and global competitiveness,” the EU says, while warning against “new risks related to user safety, including physical safety, and fundamental rights.”
Certain powerful AI models currently in wide use “could even pose systemic risks,” it says.
Emotion recognition in the workplace or at educational institutions is banned, with an exception for medical or safety reasons, such as detecting fatigue in a pilot.
Biometric categorization in public spaces, for example by camera surveillance, is also to be banned. Police and other security organs will be allowed to use facial recognition to track certain crimes, such as people-trafficking and terrorism.
Starting on Sunday, companies developing or using AI will have to assess their systems for the level of risk and take suitable measures to comply with the legal requirements.
The aim of the act is not only the protection of consumers, but also to ensure that AI is used responsibly. Providers and operators of AI systems must also ensure that those involved in development or use are in possession of an adequate level of AI competence.
