Ubisoft’s New AI-Powered In-Game Characters Interact with Players

French video game publisher Ubisoft, in collaboration with GPU maker NVIDIA and interactive NPC interactions creator InWorld, has introduced AI-powered non-playable characters (NPCs) called "NEO NPCs," aiming to improve gaming interactions. 

Unlike traditional NPCs confined to pre-scripted dialogue trees, NEO NPCs engage in real-time conversations with players, offering a more immersive gaming experience. However, the technology's integration into games remains uncertain.

The Paris AI studio used NVIDIA’s Audio2Face model and Inworld’s in-house LLM.

While early demonstrations display somewhat robotic dialogue, efforts are underway to enhance NPC interaction quality. Ubisoft emphasizes that human writers craft characters' backgrounds and personalities, guiding AI model training to align with their vision. This approach ensures consistency with gameplay objectives, preventing NPCs from becoming mere distractions.

“I’m used to building a character’s backstory, their hopes and dreams, the experiences that shaped their personality, and used all that information to nurture myself into writing dialogue. But for the first time in my life, I can have a conversation with a character I’ve created. I’ve dreamed of that since I was a kid,” says Narrative Director Virginie Mosser.

Despite advancements, there exist challenges in seamlessly integrating AI NPCs into gameplay. NPCs must serve functional roles, advancing storylines without deviating unpredictably. Ubisoft acknowledges this balance, striving to refine AI capabilities for meaningful player engagement.

Ubisoft aims to enhance player experience through genAI projects, prioritizing human creativity.  “With the player in mind, we know that developers and their creativity must still drive our projects. Generative AI is only of value if it has value for them,” says Senior Vice President of Production Technology Guillemette Picard.

Recently, Google DeepMind introduced SIMA, an AI gaming agent that responds to natural language commands to navigate various video game scenarios.