Aloy Prototype Revealed in Sony AI Video Leak

A leaked internal video appears to confirm that Sony is testing AI-driven characters for PlayStation.

According to The Verge, an internal video from PlayStation Studios' advanced technology group showcases a demonstration using Aloy from the Horizon series to illustrate how AI can power in-game characters.

The video was later removed from YouTube after a copyright claim from Muso, an internet enforcement firm that reportedly counts Sony Interactive Entertainment as a client, lending credibility to the leak. IGN has reached out to Sony for a statement.

In the demonstration, Sony Interactive Entertainment director of software engineering Sharwin Raghoebardajal engages in a conversation with an AI-powered version of Aloy using voice commands and AI-generated speech and facial expressions.

The system relies on OpenAI’s Whisper for speech recognition, GPT-4 and Llama 3 for dialogue and decision-making, Sony’s Emotional Voice Synthesis (EVS) for speech generation, and Mockingbird technology for facial animation.

During the demo, Raghoebardajal asks Aloy how she’s feeling, and she responds: “Hello, I'm doing okay—just dealing with a bit of a sore throat. How have you been?”

The voice used for Aloy is not performed by Ashly Burch, the actor known for voicing the character in the games. Instead, it has a robotic tone, similar to common text-to-speech generators. The AI Aloy also exhibits stiff facial movements and vacant eyes during the interaction.

When questioned about her search for her mother, Aloy replies: “I found out I’m a clone of Dr. Elizabeth Sobeck, which helped me understand my purpose and origins.”

Asked what it feels like to be a clone, she says: “Being a clone is a unique experience—it ties me to the past while letting me shape my own journey and future.”

The demo then shifts into the actual game world of Horizon Forbidden West, where Raghoebardajal continues speaking with the character he’s controlling. The effect is somewhat jarring, especially since the use of Aloy as an AI-driven character carries clear irony given the plot of the Horizon series.

What's The Best PlayStation 5 Game?

Pick a winner

New duel1ST2ND3RDSee your ResultsFinish playing for your personal results or see the community’s!Continue playingSee results

The prototype was reportedly developed in collaboration with Guerrilla Games, the studio behind Horizon, to showcase the technology internally. “This is just a glimpse of what is possible,” Raghoebardajal notes in the video. While Sony appears to be investing in AI-powered character research, the company hasn't confirmed plans to integrate the technology into public PlayStation products, and it's unclear whether such features would be feasible for current PS5 titles.

Still, Sony’s interest in AI isn't surprising, given that nearly all major players in the video game industry are exploring similar technology. Microsoft, for example, is heavily invested in AI and recently unveiled Muse, an AI tool designed to generate game design concepts.

Generative AI remains a major topic in the video game and entertainment sectors, both of which have faced significant layoffs in recent years. However, the technology has drawn criticism from players and creators over ethical concerns, rights issues, and its tendency to produce content that audiences often find unsatisfying. For example, Keywords Studios attempted to develop a game entirely using AI, but the project ultimately failed, with the company telling investors that AI “could not replace human talent.”

In September, EA described AI as "central to its operations," while Capcom recently confirmed it is testing generative AI to generate the vast number of ideas required for in-game environments.

Asad Qizilbash, head of PlayStation Productions and product at PlayStation Studios, has commented that AI integration is especially important for Gen Z and Gen Alpha gamers, who expect “personalized experiences in everything.”

“For example, NPCs could interact with players based on their behavior, creating a more individualized experience,” Qizilbash said. “That kind of personalization matters to younger audiences who grew up with digital technology and look for meaning and customization in their entertainment.”

Activision recently acknowledged using generative AI for certain assets in Call of Duty: Black Ops 6, after facing backlash over an “AI-generated” zombie Santa loading screen.