Sony Unveils AI-Powered Aloy Prototype in Leaked PlayStation Video

A leaked internal video shows Sony exploring AI-driven characters for PlayStation.

The Verge reported on a leaked video from PlayStation Studios' advanced technology group, featuring Aloy from the Horizon series to showcase AI-enhanced game characters.

The video was removed from YouTube after a copyright claim by Muso, an internet enforcement firm reportedly linked to Sony Interactive Entertainment, indicating its authenticity. IGN has reached out to Sony for comment.

According to The Verge, the video features Sony Interactive Entertainment’s director of software engineering, Sharwin Raghoebardajal, engaging in a dialogue with an AI-driven Aloy using voice prompts, with AI-generated speech and facial animations.

The technology includes OpenAI’s Whisper for speech-to-text, GPT-4 and Llama 3 for conversational AI and decision-making, Sony’s Emotional Voice Synthesis (EVS) for speech, and Sony’s Mockingbird for facial animations.

In the demo, Raghoebardajal asks Aloy about her well-being, and she responds: "Hi, I’m doing okay, just nursing a sore throat. How about you?"

The voice from Aloy is not that of Ashly Burch, the character’s usual voice actor, but a robotic tone akin to common text-to-speech generators used in social media narration. AI Aloy’s facial movements appear rigid, with lifeless eyes during the conversation.

When asked about her search for her mother, Aloy says: "I learned I’m a clone of Dr. Elizabeth Sobeck, which helped me understand my purpose and origins."

On being a clone, she adds: "Being a clone feels distinctive, tying me to the past while letting me forge my own path forward."

The demo shifts to the Horizon Forbidden West game world, where Raghoebardajal continues the conversation while playing. It’s unusual to see a player interact with a character they control, especially given the Horizon series’ AI-related storyline.

What’s the Top PlayStation 5 Game?

Choose a winner

New duel1ST2ND3RDSee your ResultsFinish playing for your personal results or check the community’s!Continue playingSee results

The prototype, developed with Horizon studio Guerrilla Games, was created to demonstrate this technology internally at Sony. “This is just a preview of what’s possible,” Raghoebardajal says in the video. While Sony is investing in AI-driven PlayStation characters, there’s no confirmation of this technology appearing in public-facing PlayStation products, and it’s unclear if it’s feasible for PS5 games at this stage.

Sony’s exploration aligns with industry trends, as competitors like Microsoft, which recently introduced an AI called Muse for game design ideation, are also heavily investing in AI.

Generative AI is a major focus in the gaming and entertainment sectors, both of which have faced significant layoffs recently. The technology has sparked criticism from players and creators over ethical concerns, rights issues, and its inability to consistently produce engaging content. For example, Keywords Studios’ attempt to build an AI-generated game failed, with the company noting to investors that AI “cannot replace talent.”

In September, EA called AI “the very core” of its operations, while Capcom recently shared it’s experimenting with generative AI to generate “hundreds of thousands” of ideas for in-game environments.

Asad Qizilbash, head of PlayStation Productions and product at PlayStation Studios, emphasized AI’s role for Gen Z and Gen Alpha gamers, who value “personalization across everything.”

“For example, non-player characters could respond to players’ actions, creating a more personal experience,” Qizilbash said. “This matters to younger Gen Z and Gen Alpha audiences, who grew up in a digital world and seek personalized, meaningful experiences.”

Activision recently faced backlash for using generative AI in some Call of Duty: Black Ops 6 assets, particularly for an “AI slop” zombie Santa loading screen.