World Wire

How do you benchmark a web search API when the thing being tested can read the answer key? A search agent has a fetch tool. If the gold labels sit in a public dataset, the agent can download them mid-evaluation and skip retrieval entirely. A similar problem arises when the answers are already encoded in the model’s parametric memory: a correct response no longer demonstrates that web search worked. Keenable’s answer is NEEDLE , a live open-source benchmark that rebuilds its query set from fresh public sources rather than freezing one. News queries are regenerated hourly from RSS feeds and Google Trends; finance, scholar, legal, and rare-entity queries are regenerated daily from SEC XBRL, arXiv, Europe PMC, CourtListener, and public agent logs. Fifteen search APIs run against the same query text under one protocol, and every score is read against ultimate , a pooled oracle engine that marks what the whole field managed to find. Is it reproducible? Yes, as an open source ev...

Google Research has released TimesFM-3 , a 330 million parameter time series foundation model that forecasts multiple related series in a single forward pass. Every TimesFM checkpoint through 2.5 was univariate: one series, its own history, nothing else. TimesFM-3 is pretrained natively for multivariate forecasting on more than 1 trillion time points, and accepts multiple targets, past covariates, and past-future covariates with no task-specific fine-tuning. It takes the top average rank among pretrained foundation models on GIFT-Eval, fev-bench, and the TIME leaderboard, on both point and probabilistic metrics. https://research.google/blog/timesfm-3-a-zero-shot-foundation-model-for-multivariate-forecasting/ Is it deployable? Partial , the TimesFM repository code is Apache-2.0 , but the TimesFM 3.0 weights ship under timesfm-non-commercial-license-v1.0 . They are restricted to non-commercial, non-production use. You can benchmark it today. You cannot ship it behind a prod...

The OpenClaw team has just released OpenClaw 2.0 . The team shipped nothing for nearly seven weeks, after 106 releases in the previous 230 days. The update rewrites installation and rebuilds the browser Control UI . It also moves sessions and transcripts into SQLite and adds shared cloud sessions . Is it deployable? Yes for single-operator and single-team deployments. No for multi-tenant products. Setup starts from credentials you already have Guided setup now looks for AI access already on the machine. It can reuse verified Codex, ChatGPT or Claude CLI sign-ins, accept an API key, run a provider sign-in, or find installed Ollama and LM Studio models. It then proves the exact choice can answer before saving that model and credential. Fresh OpenAI setups default to GPT-5.6. On the local side, node-llama-cpp was replaced with a managed llama-server , Gemma 4 became the RAM-gated llama.cpp default, and the llama.cpp default context was raised to 64K. The browser app ...