Industry8d ago
SemiAnalysis Releases Landmark Datacenters 2027 Report: +50GW in a Single Year, $1.3T in Lease Contracts, and Shifting Supply Bottlenecks
SemiAnalysis published its major forward-looking industry analysis 'Datacenters 2027: The Year of Acceleration'. The report reveals an unprecedented +50GW of capacity added in a single year, 60GW under construction, and over $1.3T in signed lease contracts year-to-date. As massive power and real-estate infrastructure projects come online by 2027, the primary bottleneck in the AI supply chain is projected to pivot from grid power back to leading-edge accelerator silicon.
Tooling6d ago
Eagle releases EAGLE-4, a speculative-decoding drafter that adapts to batch size and hardware; it reports 961.6 tok/s on Qwen3.8-27B for a single request
On Oct 20, inference company Eagle released EAGLE-4, the fourth generation of the EAGLE speculative-decoding family. One drafter resizes its speculative tree for the batch size, hardware and workload while keeping the target model's output distribution. Eagle reports 961.6 tokens/s for one request on Qwen3.8-27B with 4x B300. The code ships as eagle-harness v0.1.0 with plugins for SGLang, vLLM and an experimental TokenSpeed backend. Many reposts call it open source, but the official license is source-available, not OSI open source.
Tooling9d ago
vLLM and NVIDIA ship a specialized Kimi K3 decode path on GB300: 842 tok/s at batch 1, 1.3–1.9x faster without speculation
A vLLM blog post by NVIDIA engineer Benjamin Chislett details an agent-assisted CuTe DSL decode path for Kimi K3 on NVIDIA GB300 that fuses attention, MoE and NVLink communication, cutting per-layer time from 130 µs across 23 kernels to 69 µs across 13. With DSpark speculative decoding on 16 GPUs it reaches 842 tok/s at batch 1, 1.73x stock vLLM; PR #61867 was merged on Oct 16.
Discussion & Comments
0Sign in to join the discussion
Connect with AI developers to exchange benchmark insights.