Posts

NVIDIA Releases Nemotron-Labs-3-Puzzle-75B-A9B: A Compressed Hybrid MoE LLM Delivering 2.03x Server Throughput at Matched User Throughput

Image
Large hybrid MoE models like Nemotron-3-Super are accurate but expensive to serve. Their active parameters, KV cache, and Mamba state cap how many users a node can hold at a given per-user token rate. NVIDIA AI team has released Nemotron-Labs-3-Puzzle-75B-A9B , a compressed variant of Nemotron-3-Super. The parent model has 120.7B total and 12.8B active parameters. The compressed model has 75.3B total and 9.3B active parameters. The deployment target was fixed before the architecture search began. Target one was 2x server throughput at 100 tokens per second per user. Target two was 8 concurrent 1M-token requests on a single H100. Three checkpoints on Hugging Face: BF16, FP8, and NVFP4. TL;DR 120.7B/12.8B active compresses to 75.3B/9.3B active, with the 88-block hybrid layout preserved. 8xB200 total throughput rises 1.60x to 2.14x over Super at matched NVFP4 and matched user throughput. Single-H100 1M-token concurrency goes 1 to 8, driven by a 70 GB to 44.5 GB weigh...

Datalab Lift vs the Field: How a 9B Schema-First Extractor Compares with NuExtract3, LlamaExtract, Marker, and Docling

Datalab’s Lift is a focused document extraction tool with a specific promise: give it a PDF or image plus a JSON Schema, and it returns schema-shaped JSON directly. Instead of converting a document to Markdown first and then asking another model to extract fields, Lift reads rendered page images and attempts to emit the final structured object in a single pass. According to Datalab, Lift is a 9B vision model for structured JSON extraction from PDFs and images, supports schema-constrained decoding, and returns JSON that matches the user’s schema. That positioning matters because Lift is not mainly an OCR engine, not mainly a PDF-to-Markdown converter, and not a full enterprise document review platform. It is best understood as a schema-first document extractor : a model for turning visually complex documents into application-ready fields. First, the distinction that organizes everything: parsing vs. extraction Most document AI tools solve one of two different p...

OpenAI Releases GPT-Live and GPT-Live-1 mini: Full-Duplex Voice Models That Delegate Deeper Reasoning to GPT-5.5

Today, OpenAI released GPT-Live . It is a new generation of voice models. GPT-Live now powers the ChatGPT Voice experience. The stated goal is natural, real-time conversation with AI. Two versions ship first: GPT-Live-1 and GPT-Live-1 mini . Both roll out to ChatGPT users globally today. TL;DR GPT-Live is a full-duplex voice model family that listens and speaks at once. It delegates search and reasoning to GPT-5.5 while keeping the conversation flowing. GPT-Live-1 and mini were strongly preferred over Advanced Voice Mode in human tests. It ships today to ChatGPT users globally; the API is planned soon. Video, screen sharing, and full multilingual parity are not available at launch. What is GPT-Live? GPT-Live is built on a full-duplex architecture . Full-duplex means the model can listen and speak at the same time. During a conversation, it can add short cues like ‘mhmm’ or ‘yeah.’ It can engage in quick back-and-forth, or stay ...