Meet Varkos: The Real-Time AI Companion Revolutionizing Gaming with Evolving Personalities and Lightning-Fast Responses

August 24, 2026
Meet Varkos: The Real-Time AI Companion Revolutionizing Gaming with Evolving Personalities and Lightning-Fast Responses
  • Varkos is a real-time AI gaming companion designed to play alongside the player, demonstrated in Skyrim and engineered to be pluggable into other games or usable as a standalone system.

  • The project targets ultra-low latency across the stack, with specific goals such as 40-80 ms AI video tick, 20-60 ms audio generation, 2-20 ms action analysis, and 300-600 ms grounding, prioritizing streaming and rapid responsiveness.

  • Personality evolution is central, with initial traits that can evolve through shared experiences; irritability, affection, and playfulness can change over time, and these changes are versioned and reversible.

  • There is consideration of open-sourcing certain components, a philosophical lens on AI companions, and future plans to support multiple NPCs.

  • The team acknowledges current limits in long-term memory and cross-turn coherence, limited benefits from remote LLMs, and hardware demands that constrain real-time performance, though improvements are expected.

  • Core goals focus on usefulness and instant gameplay with multiple actions, a sense of being alive and present through evolving personality, and private/local operation to reduce cloud costs and latency.

  • Varkos can handle complex, multi-step commands with persistent planning and can execute grounded tasks like item searches, looting, and coordinating combat.

  • The technical stack highlights include an always-on microphone, Qwen3-ASR for speech-to-text, PocketTTS-Raven for voice synthesis, an Action Latent Encoder for planning, and a fast local LLM-based grounding system.

  • The project embraces an experimental, exploratory tone, emphasizing collaboration with players over traditional talking NPCs and maintaining openness to sharing developments over time.

  • Examples show Varkos handling long-form commands, multi-step loot routines, and real-time reactions to world events, including item searches and hide-and-seek.

  • The dog-in-and-out-of-game concept (void mode) envisions Varkos existing outside a single game and moving across platforms, potentially spanning titles like Skyrim and Microsoft Flight Simulator.

Summary based on 1 source


Get a daily email with more Startups stories

Source

I Built an AI Companion That Actually Plays With You

Pantelis Kalogiros • Aug 23, 2026

I Built an AI Companion That Actually Plays With You

More Stories