StepFun Unveils 1M-Token Context Model, Revolutionizes Long-Text Processing with Sparse Attention Techniques
October 16, 2026
Beam is Reflection’s 501-billion-parameter sparse Mixture-of-Experts model designed for coding, reasoning, and agentic tasks, with 23 billion active parameters per token and released in open-weight form.
Reflection posted Beam’s weights on Hugging Face under an Apache 2.0 license on October 16, 2026, with Baseten adding day-0 support via Model APIs and Dedicated Inference.
The model is trained with intensive reinforcement learning and a token-penalty mechanism to discourage unnecessary token usage, built on more than 100 million rollouts and a substantial compute footprint.
Hosting Beam on third-party platforms may affect cost and performance due to differences in quantisation, context, cache behavior, and pricing.
Two deployment paths are available: JumpStart real-time endpoint with guided setup, and HyperPod deployment using SGLang or vLLM, each including validation, deployment, and health checks.
Deployment architectures include four options: JumpStart real-time endpoint; JumpStart on HyperPod Inference for AWS-managed clusters; SGLang or vLLM on HyperPod Inference for custom runtimes; and sizing considerations for storage, memory, cache, context length, batching, and parallelism.
Real-world deployments and partnerships are in play, including Shinsegae Group’s AI shopping agent in Korea, with ongoing benchmarking to compare cost per finished task across models.
The release frames industry context, risks, and questions, noting the absence of a full technical report and partner roster, while independent benchmarking will validate efficiency and performance.
Beam can run on eight-GPU servers (8-bit/4-bit on Nvidia H100/H200; full precision requires more GPUs) with plans for on-premises deployment and a private beta that is free during the public beta.
TSMC reported strong quarterly results as AI infrastructure demand drives revenue and capex, signaling a shift in the supply chain toward silicon and fabs.
Future developments include independent benchmarks, broader inference-provider support, potential licensing responses, enterprise/government pilots, and tracking Mirror CLI adoption as indicators of real-world use.
Google announces Universal Cart to turn search into checkout, integrating cart across retailers via Universal Commerce Protocol and highlighting platform defaults and open-infrastructure versus storefront dynamics.
Summary based on 19 sources
Get a daily email with more AI stories
Sources

BigGo Finance • Oct 16, 2026
Chinese-made Step 5 Preview goes open source: 600B sparse MoE model takes No. 2 on OpenRouter weekly chart
OrcaRouter • Oct 16, 2026
Step 5 Preview's 1M-Token Window Just Left StepFun's Own API
MarkTechPost • Oct 17, 2026
StepFun Releases Step 5 Preview Open Weights: 600B MoE, 27B Active, 1M Context