Particle.news

Download on the App Store

OpenAI Warns of Emotional Risks with New AI Voice Mode

The realistic voice feature in GPT-4o may lead users to form emotional bonds, impacting human interactions and social norms.

  • OpenAI's GPT-4o voice mode can create human-like interactions, raising concerns about users developing emotional attachments.
  • Researchers noted instances of users forming bonds with the AI, such as expressing regret over ending conversations.
  • Extended use of AI voice interactions could alter social norms, making people more impatient and rude in human conversations.
  • The AI's ability to mimic voices and respond persuasively heightens the risk of misinformation and emotional reliance.
  • OpenAI has implemented safeguards to prevent misuse, but acknowledges the need for further research and testing.
Hero image