Posts

PrismML Releases Ternary Bonsai 2 27B: A 5.9 GB Apache 2.0 Model Retaining 98.2% of Qwen3.8 27B Performance

PrismML has released Ternary Bonsai 2 27B , a ternary-weight version of Qwen3.8 27B . The language model occupies 5.93 GB, against 53.80 GB in FP16. PrismML reports that it keeps 98.2% of the parent model’s average across 20 benchmarks. The model accepts text and images and supports a 262K-token context. PrismML demos it driving Cline coding agents and computer use on an RTX 5090. It arrives 2 months after the first Bonsai 27B , whose ternary variant retained about 95%. Is it deployable? Yes. The Apache 2.0 weights run today on a 16 GB laptop or a single 24 GB GPU. You need PrismML’s llama.cpp fork or its MLX runtime. What is Ternary Bonsai 2 27B? The model keeps the Qwen3.8 27B architecture unchanged. It has 27.36B parameters. That splits into a 24.35B language backbone, 2.54B in embeddings and LM head, and a 0.47B vision tower. The backbone uses hybrid attention, with about 75% linear-attention and 25% full-attention layers. Ternary weights cover embedd...

Best Open-Source Agent Harnesses for Local LLMs in 2026

An agent is a model and a harness. The harness runs tools, holds state, manages permissions, and feeds context back to the model. With a local model, the harness matters more. Small context windows and weaker tool calling expose every design flaw. This guide ranks 11 open-source harnesses by how well they document local inference. All repo facts were read from GitHub on September 18, 2026. The ranking weighs 4 things: OSI-approved license, documented local runtimes, maintenance status, and safety controls. The 3 rules that apply to every harness 1. Raise the context window first : Per Ollama’s context length docs , defaults depend on VRAM: 4k under 24 GiB, 32k from 24 to 48 GiB, and 256k at 48 GiB or more. The same page says agents and coding tools should get at least 64,000 tokens. The fix is one line: OLLAMA_CONTEXT_LENGTH=64000 ollama serve . 2. Pick a model that supports tool calling : Goose’s provider docs state that models without tool calling can onl...

Alibaba Qwen Releases Qwen3.8-Omni-Flash: A 1M-Context Omni-Modal Model Built Around Agentic Audio-Video Understanding and Tool Use

Image
Alibaba’s Qwen team has released Qwen3.8-Omni-Flash . They called it its first omni-modal model built around agentic capabilities. It accepts text, images, audio, and video, and it returns text. Audio-video understanding, reasoning, and tool use sit inside one model. The stated workflow is simple: understand the content, plan the task, execute with tools, deliver the result. Is it deployable? Yes, as a hosted API today. It is live on QwenCloud , Alibaba Cloud Model Studio , and Qwen Studio . No open weights were announced at launch, so self-hosting is not an option. What is Qwen3.8-Omni-Flash The Qwen3.8-Omni-Flash is built on the Qwen3.8-Flash-Next architecture. That base model shipped with open weights in August 2026. The context window is 1M tokens. QwenCloud lists 991K max input and 131K max output. Max reasoning length is 262K tokens. Output is text only. The Model Studio docs point developers to Qwen3.5-Omni when they need generated speech. Thinking i...