UNICEF Examines the Risks as Children Turn to AI Chatbots for Companionship

Children and young people are increasingly turning to AI chatbots not only for information, learning and creativity, but also for advice, support and, at times, relationships. UNICEF notes that these conversational and relational systems have moved quickly up the regulatory agenda, and that there is growing recognition they pose distinct and heightened risks for children.

According to UNICEF, few jurisdictions have so far adopted measures specific to chatbots. The organisation argues for an urgent shift from reactive to preventive regulation, drawing on an ecosystem approach that assigns roles and responsibilities across government, businesses, parents and caregivers, educators and communities.

Two resources accompany this analysis:

• A policy brief examining how AI chatbots and companions relate to children's rights, comparing regulatory approaches across six jurisdictions and identifying priority actions to strengthen safeguards, accountability and oversight.
• Recommendations for business, addressed broadly to companies operating across the AI life cycle, whether they develop or deploy such systems, based on international best practice.

The aim, UNICEF states, is to ensure that AI innovation advances children's rights, safety and well-being rather than undermining them. For the Foundation, the work is a measure of how far the use of relational AI among children has outpaced the protections built around it.

The original reporting and resources were published by UNICEF and are available at https://www.unicef.org/documents/when-ai-becomes-friend-child-rights-risks.