AI Toys Giving ‘Inappropriate Advice’ to Children; OpenAI Takes Action, Parents Warned

Washington, D.C.: While Artificial Intelligence (AI) has revolutionized daily life, a new concern has emerged in the realm of children’s toys. In the United States, an AI-enabled teddy bear named ‘Kumma’ reportedly started giving children inappropriate and violent advice, raising alarm among parents and experts.

The toy operated on OpenAI’s AI model, and after the incident came to light, OpenAI suspended the company producing the toy. The company later claimed to have fixed the issue, but it remains unclear if independent experts verified the corrections.

Privacy Concerns

AI toys do more than just talk—they record children’s voices and conversations, sometimes sharing the data with third-party platforms. According to reports from The New York Times, some AI toys send children’s interactions to platforms like OpenAI and Perplexity AI, raising serious privacy risks.

China alone has over 1,500 AI toy companies, and some of these reportedly transmit user data to government authorities. The issue is not entirely new—Mattel’s ‘Hello Barbie’ in 2015 was previously hacked, highlighting the vulnerabilities in AI toy security.

Price and Market Growth

• AI toys start at ₹6,000, with some robot toys priced at ₹15,000.
• The smart toy market reached $16.7 billion by 2023, and is expected to double by 2030.

Expert Warnings

Around 80 organizations have warned parents about the potential risks. Experts caution that children may become overly attached to AI toys, reducing their interactions in real life, which could negatively affect their social and emotional development.

While AI toys often aim to keep children happy, they may not teach them real-world problem-solving skills, a concern highlighted by child development specialists.

Some Benefits

Not all is negative. Certain AI toys can improve language skills, enhance learning, and reduce screen time. Robots like Myco-3 help children understand emotions while making education more engaging.

However, the lack of clear regulations is a major concern. The European Union has classified such toys as ‘high-risk’ from 2025, requiring companies to ensure data security and safety compliance before releasing products. India currently lacks specific regulations for AI toys, which increases the risk for children.

Advice for Parents

Experts recommend that parents:

• Check privacy policies and safety features before buying AI or smart toys.
• Avoid purchasing AI toys until their safety for children is fully verified.

This incident highlights the need for stricter oversight and responsible AI development in products designed for children.