Governments have focused on the potential misuse of artificial intelligence for fraudulent and malicious online activity. In the U.K., regulators are now exploring how AI can be used to combat harmful content targeting children.
Ofcom, responsible for enforcing the U.K.’s Online Safety Act, will initiate a consultation on the current and future use of AI and automated tools to detect and remove illegal online content, specifically to safeguard children from harmful material and identify previously undetectable child sexual abuse content.
These tools are part of a broader set of proposals by Ofcom to enhance online child safety. Consultations on these comprehensive proposals will commence soon, with the AI consultation being launched later this year.
Mark Bunting, a director in Ofcom’s Online Safety Group, emphasizes the importance of evaluating the efficiency of AI screening tools used today to protect children from harmful online content. Industry compliance in assessing and managing risks to free expression and privacy with the use of these tools is a key focus.
Ofcom is likely to recommend improvement measures for platforms, potentially leading to more sophisticated tools and possible fines for non-compliance in blocking harmful content and better safeguarding young users.
While AI researchers continue to develop advanced tools for detecting deepfakes and verifying user authenticity, skeptics highlight the limitations of AI detection. The consultation on AI tools comes alongside Ofcom’s latest research on children’s online engagement in the U.K., revealing a surge in young children owning smartphones and engaging in online activities.
As younger children increasingly access online platforms, concerns regarding age restrictions on social media apps rise. The research indicates a significant usage of social media among 5- to 7-year-olds, with platforms like WhatsApp and TikTok being popular choices. Despite the growing presence of children online, parental oversight and communication on online safety remain crucial.
Ofcom’s research also indicates a discrepancy between what older children encounter online and what they report to their parents. Issues like exposure to harmful content and challenges in recognizing deepfakes underscore the need for effective online safety measures and communication between children and parents.
