Posts

Beyond Domain-Specific World Models: JEPA-Anything Uses 1 Recipe for 7 Fields

Researchers from PhAI Labs, CUHK, Fudan, Stanford, Oxford and Princeton have released JEPA-Anything , a domain-agnostic framework for building world models. Instead of designing a new predictive model for each field, it applies one shared learning recipe to very different systems. It extends joint-embedding predictive architectures (JEPAs) with a method called Orthogonal Predictive Factorization (OPF) . The research team tested it across 7 domains: vision, biology, clinical trajectories, control, molecular dynamics, physical fields and weather. What problem does JEPA-Anything solve? A standard JEPA, such as I-JEPA or V-JEPA 2 , uses a context encoder, an EMA target encoder and one predictor. The predictor outputs one monolithic target embedding. The research team call this a capacity-allocation problem: high-variance structure dominates, and weaker modes get conflicting gradients. How does Orthogonal Predictive Factorization work? OPF splits the latent target of width...

Reflection AI Introduces Beam: A 501B Open-Weight MoE Model With 23B Active Parameters for Coding and Agentic Workloads

Reflection AI has introduced Beam, its first open-weight model. Beam is a sparse Mixture-of-Experts (MoE) model with 501B total parameters and 23B active per token, built for coding, reasoning and agentic workloads. As per the Reflection AI team, Beam directly competes with larger open models like GLM 5.2 while using 3 to 4x less inference compute on reasoning benchmarks. Is it deployable today? Not for self-hosting yet. Beam is in final red-teaming. Early access runs through a waitlist on the Reflection platform . What is Reflection Beam? Beam is a general agent model trained from scratch by Reflection AI. It targets enterprise coding and agentic workloads. Reflection positions Beam as advancing the Western open-weight frontier. The research team is candid about the gap. Kimi K3 stays ahead on raw capability, so Beam’s pitch is efficiency at inference time. Users get a reasoning effort parameter . Lower settings favor short answers. Higher settings allow longer...

Yandex Introduces Sona: A Single Generative Recommender That Replaces Entire Recommendation Cascade

Most production recommenders are cascades. Candidate generators feed a pre-ranker, which feeds a heavy ranker built on hundreds of engineered features. Yandex’s Sona Technical Report describes a different design. Sona is a generative AI model that brings candidate generation and ranking into a single system, replacing the multiple stages typically used in recommendation pipelines. Yandex tested the model in a seven-day live production experiment on its smart speakers. In an online A/B test, it replaced more than 15 candidate generators, the pre-ranking stage, and the ranking stage with one served transformer. What Problem Does Sona Solve? Cascades split one decision across separately trained models. Each stage optimizes its own objective, and the ranker only sees what upstream stages let through. Yandex’s previous stack on the Yandex Music surface consumed hundreds of features, including signals from Argus , Yandex’s earlier recommender transformer. Sona puts...

The Story of Qwen: Alibaba’s AI Models From 7B to 2.4T

In April 2023, Alibaba Cloud demoed a chatbot whose name roughly means ‘truth from a thousand questions.’ Three and a half years later, its descendant ships open weights with 2.4 trillion parameters. This is the story of how Qwen got there, release by release. Chapter 1 — 2023: a thousand questions Alibaba moved after ChatGPT, but not by much. On April 7, 2023, Alibaba Cloud began handing invitation codes to corporate customers for a model called Tongyi Qianwen. The name draws partly on the philosopher Mencius. Four days later, at the Alibaba Cloud Summit in Beijing, then-CEO Daniel Zhang unveiled it publicly. Alibaba said it would roll the model into every business , starting with DingTalk and the Tmall Genie voice assistant ( China Daily ). The real turn came in August. On August 3, 2023, Alibaba open-sourced Qwen-7B and Qwen-7B-Chat , a direct answer to Meta’s Llama 2. Qwen-7B was pretrained on over 2.2 trillion tokens with a 2,048-tok...