AI

Ubisoft Tests Voice-Controlled AI Teammates in Playable Prototype

The experimental shooter lets players command NPCs and an AI assistant named Jaspar through natural speech, exploring new interaction models beyond scripted dialogue.

Omega Editorial · November 20, 2026 · 3 min read

Key takeaways

  • Ubisoft's Teammates prototype lets players control AI squadmates and an assistant named Jaspar through natural voice commands in a playable first-person shooter.
  • The system processes environmental context to interpret spoken instructions, enabling NPCs to respond dynamically rather than following scripted dialogue trees.
  • Writers establish narrative boundaries within which AI characters can improvise responses while maintaining story consistency and character motivations.
  • Several hundred players have tested the experiment in closed sessions, with feedback shaping ongoing research into voice-controlled gameplay.
  • The project aims to enhance rather than replace creative work, combining AI capabilities with human-authored story structures and character design.

Ubisoft has released details of Teammates, a playable research project that explores how generative AI can enable real-time voice control of in-game characters and systems. The experimental first-person shooter features an AI assistant called Jaspar and two NPC squad members who respond dynamically to spoken commands.

The prototype places players in a dystopian resistance scenario, navigating an enemy base to locate five missing team members. Players must direct their AI-controlled squadmates Sofia and Pablo through voice instructions while Jaspar provides assistance, story context, and can adjust game settings on command.

How the Voice System Works

The underlying technology processes environmental information and contextual cues to interpret natural language input. In an early scenario, players encounter patrolling enemies before receiving a weapon. Success requires verbally directing Sofia and Pablo to take cover positions and coordinating their attacks through spoken instructions.

Jaspar extends beyond basic assistant functions. The AI can highlight enemies, deliver lore details, modify settings, or pause gameplay through conversational commands. According to Director of Gameplay GenAI Xavier Manzanares, early testing showed players quickly connected with the voice-driven interaction model, particularly when uncertain about objectives or seeking world information.

Creative Direction Meets AI Systems

Narrative Director Virginie Mosser described the development approach as collaborative rather than replacement-focused. Writers still craft story arcs and character personalities, but instead of fixed dialogue trees, they establish boundaries within which NPCs can improvise responses while maintaining narrative consistency.

"I still write the story and character personalities, but instead of fixed lines, we create these kinds of fences that let NPCs improvise within the world but stay within the boundaries of the lore and motivations we have given them," Mosser explained.

Data & AI Director Rémi Labory emphasized that the system enables player input to shape character reactions in real time, something traditional scripted development cannot achieve. The project includes a complete pipeline from player onboarding through debrief.

Why It Matters

This experiment represents a significant shift in how players might interact with game worlds beyond button inputs and menu selections. If voice-controlled AI companions can respond contextually while maintaining narrative coherence, it could enable more accessible gameplay for players who struggle with complex control schemes and create emergent storytelling moments impossible with pre-scripted dialogue. The technology's viability depends heavily on whether the boundaries Mosser describes can prevent AI responses from breaking immersion or contradicting established lore.

Research Phase and Next Steps

The team has conducted closed playtests with several hundred players, gathering feedback to refine the systems. Ubisoft plans to continue developing the technology and testing it with both players and internal creative teams. The company intends to release an explainer video detailing the technical implementation.

This follows Ubisoft's Neo NPC experiment revealed at GDC 2024, indicating sustained research investment in AI-driven character interaction systems. These details were first reported by Ubisoft in an official announcement on their news site.

  • #generative ai
  • #voice control
  • #game development
  • #ubisoft
  • #npc ai
  • #interactive storytelling

This is an original analysis by the Omega editorial team. Source reporting: The Verge.

Want systems like this working for your business?

Book a Call

More in AI