Inference

Reporting, analysis and primary-source coverage on Inference.

Latest coverage
AWS Launches SGLang-Neuron on Trainium3 as CEO Says Cloud Adds an AI Chip Every 14 Seconds

Enterprise & Cloud

AWS Launches SGLang-Neuron on Trainium3 as CEO Says Cloud Adds an AI Chip Every 14 Seconds

Amazon released a public Trainium inference container built with RadixArk and Annapurna Labs as AWS chief Matt Garman warned inference demand has barely started.

Jin

Apple Targets Local AI Developers With M6 14-Inch MacBook Pro Featuring Dual Neural Engines

Devices & Gadgets

Apple Targets Local AI Developers With M6 14-Inch MacBook Pro Featuring Dual Neural Engines

Now shipping across 35 countries starting at $1,999, Apple's 14-inch MacBook Pro with M6 packs GPU Neural Accelerators and 170GB/s memory bandwidth for lo…

Jin

Space-AI Developer Ada Space Raises $95.6M in Hong Kong IPO for In-Orbit Computing

Space & Frontier

Space-AI Developer Ada Space Raises $95.6M in Hong Kong IPO for In-Orbit Computing

Chengdu-based satellite AI company Ada Space raised $95.6 million on the Hong Kong Stock Exchange to expand its constellation of orbital AI compute satell…

Rachel Lim

Google and AMD Detail Confidential AI Computing on 8th-Gen TPU 8tx and 5th-Gen EPYC

Chips & Compute

Google and AMD Detail Confidential AI Computing on 8th-Gen TPU 8tx and 5th-Gen EPYC

Google and AMD shared technical details on pairing 5th-Gen AMD EPYC host processors with Google's 8th-generation TPU 8tx to run hardware-enforced confiden…

Marcus Vance

LMSYS Launches SGLang Inference Consortium With Nvidia, AMD, Intel, Google and Meta

Chips & Compute

LMSYS Launches SGLang Inference Consortium With Nvidia, AMD, Intel, Google and Meta

At the SGLang Summit in San Francisco, LMSYS Org formed the SGLang Consortium alongside major silicon and cloud providers to standardise open-source AI in…

Marcus Vance

Google, Nvidia, Microsoft Among Seven Backers Committing $26 Billion to Anthropic IPO Placement

Growth & IPOs

Google, Nvidia, Microsoft Among Seven Backers Committing $26 Billion to Anthropic IPO Placement

Seven chip and cloud heavyweights including Google, Nvidia, Microsoft, AMD, Broadcom, Micron, and TSMC Partners agreed to buy $26 billion of Anthropic sto…

Rachel Lim

AWS Hits $184 Billion Run Rate as Cloud Giants Split Over AI Platform Strategy

Enterprise & Cloud

AWS Hits $184 Billion Run Rate as Cloud Giants Split Over AI Platform Strategy

Third-quarter results showed AWS accelerating 39.3% to $46 billion in quarterly sales while Azure and Google Cloud lean harder into proprietary workplace …

Aarav Mehta

OpenAI Raises $15 Billion at $1.25 Trillion Valuation on Path to 2027 IPO

Growth & IPOs

OpenAI Raises $15 Billion at $1.25 Trillion Valuation on Path to 2027 IPO

OpenAI has secured $15 billion in bridge financing ahead of an anticipated 2027 public listing, finishing at half the $30 billion figure initially pitched…

Rachel Lim

Legora: Inside the Nvidia-Backed Legal AI Platform Challenging Corporate Law Firms

Agents & Tools

Legora: Inside the Nvidia-Backed Legal AI Platform Challenging Corporate Law Firms

A technical breakdown of Legora's legal AI architecture, enterprise contract automation workflows, and why Nvidia backed its expansion across global law f…

Jin

Inside Project QuiltWorks and the AI-Driven Vulnerability Storm

Breaches & Threats

Inside Project QuiltWorks and the AI-Driven Vulnerability Storm

The window between software creation and weaponized exploitation has effectively vanished, as the fastest eCrime breakout is now measured in seconds rathe…

Jin

Why NVIDIA Cosmos and Cadence Just Solved Robotics’ Biggest Problem

Robotics & Defence

Why NVIDIA Cosmos and Cadence Just Solved Robotics’ Biggest Problem

We’ve mastered text and image generation, but making robots work reliably in the real world is a completely different beast. Here is why the newly expande…

Jin

Google Gemma 4 Review: 5 Reasons Developers Are Switching (Apache 2.0 & Benchmarks)

Models & Research

Google Gemma 4 Review: 5 Reasons Developers Are Switching (Apache 2.0 & Benchmarks)

Why developers are switching to Google's open-weight Gemma 4 models: Apache 2.0 commercial licensing, native multimodal audio on edge devices, parameter s…

Jin