Meet Varkos: The Real-Time AI Companion Revolutionizing Gaming with Evolving Personalities and Lightning-Fast Responses
August 24, 2026
Varkos is a real-time AI gaming companion designed to play alongside the player, demonstrated in Skyrim and engineered to be pluggable into other games or usable as a standalone system.
The project targets ultra-low latency across the stack, with specific goals such as 40-80 ms AI video tick, 20-60 ms audio generation, 2-20 ms action analysis, and 300-600 ms grounding, prioritizing streaming and rapid responsiveness.
Personality evolution is central, with initial traits that can evolve through shared experiences; irritability, affection, and playfulness can change over time, and these changes are versioned and reversible.
There is consideration of open-sourcing certain components, a philosophical lens on AI companions, and future plans to support multiple NPCs.
The team acknowledges current limits in long-term memory and cross-turn coherence, limited benefits from remote LLMs, and hardware demands that constrain real-time performance, though improvements are expected.
Core goals focus on usefulness and instant gameplay with multiple actions, a sense of being alive and present through evolving personality, and private/local operation to reduce cloud costs and latency.
Varkos can handle complex, multi-step commands with persistent planning and can execute grounded tasks like item searches, looting, and coordinating combat.
The technical stack highlights include an always-on microphone, Qwen3-ASR for speech-to-text, PocketTTS-Raven for voice synthesis, an Action Latent Encoder for planning, and a fast local LLM-based grounding system.
The project embraces an experimental, exploratory tone, emphasizing collaboration with players over traditional talking NPCs and maintaining openness to sharing developments over time.
Examples show Varkos handling long-form commands, multi-step loot routines, and real-time reactions to world events, including item searches and hide-and-seek.
The dog-in-and-out-of-game concept (void mode) envisions Varkos existing outside a single game and moving across platforms, potentially spanning titles like Skyrim and Microsoft Flight Simulator.
Summary based on 1 source
Get a daily email with more Startups stories
Source

Pantelis Kalogiros • Aug 23, 2026
I Built an AI Companion That Actually Plays With You