Tooling1d ago
Google's Gemma team says Gemini 4 Argon wrote vLLM optimizations that speed up gemma-4-E2B-it 2.85x on an A100
On Oct 26, Google's official @googlegemma account said a set of vLLM optimizations built with Gemini 4 Argon lifted gemma-4-E2B-it throughput on a single A100 from about 37,900 to 108,000+ tokens/sec, roughly 2.85x, with 100% token parity. The PRs were filed by Luciano Martins of Google DeepMind, and most are still under review.
Tooling41d ago
Vercel: TypeSafe Jev Coming to AI Gateway — Up to 18× Faster Than GPT Luna
Vercel CEO Guillermo Rauch said fx’s default auto mode uses a safety reviewer on every command. That reviewer runs on GPT Luna today; TypeSafe’s Jev is up to about 18× faster at p95 and more accurate, and is coming to Vercel AI Gateway as a likely new default. Earlier, a Vercel engineer reported Jev saturating a classifier eval vs Gemini 2.5 Flash Lite while running about 6× faster.
Tooling5d ago
Google previews Gemini API CLI (gemini-api), a zero-dependency Go binary that lets Claude Code, Codex, Cursor and other coding agents generate media, transcribe and run managed agents from the shell
The Google AI Studio team released an experimental preview of the Gemini API CLI (command name gemini-api). It is a stateless, zero-dependency Go binary for macOS, Linux and Windows, open source under Apache 2.0. Any coding agent with shell access and a GEMINI_API_KEY can call text reasoning, image, video, music and speech generation, file and YouTube analysis, audio and video transcription, and managed agents such as Deep Research with one command. Media is written straight to disk and only the file path goes to stdout, so base64 payloads never land in the context window. Google labels it experimental and not a supported Google product.
Discussion & Comments
0Sign in to join the discussion
Connect with AI developers to exchange benchmark insights.