TechWhoKnows
Log inSign up
Latest
AI
Startups
Venture
Tech
Security
Hardware
Biotech & Climate
Markets & Policy
Companies
TopicsNewsletterAbout
TechWhoKnows

Independent tech news from Singapore, with the sources linked.

Sections

  • AI
  • Startups
  • Venture
  • Tech
  • Security
  • Hardware
  • Biotech & Climate
  • Markets & Policy

TechWhoKnows

  • Companies
  • About
  • Newsletter
  • All topics
  • Search
  • Account

© 2026 TechWhoKnows. All rights reserved.

  • Privacy
  • Terms
Home/Topics/LLM Inference

LLM Inference

Reporting, analysis and primary-source coverage on LLM Inference.

Latest coverage
LatestMost read
MAS Opens Future of Finance Institute With PathFin.ai and SafeFin.ai

Asia & SEA Tech

MAS Opens Future of Finance Institute With PathFin.ai and SafeFin.ai

Singapore's MAS launched the Future of Finance Institute under interim CEO Alan Lim to move banks from AI pilots to production under SAFR and MindForge.

Jin16 Nov

vLLM vs SGLang vs TensorRT-LLM (2026 Comparison): Throughput, KV Caching, and Security

Agents & Tools

vLLM vs SGLang vs TensorRT-LLM (2026 Comparison): Throughput, KV Caching, and Security

Compare vLLM, SGLang, and TensorRT-LLM in 2026 across PagedAttention, RadixAttention prefix caching, TensorRT compilation, and inference server security.

Jin15 Nov

AWS Says AI Inference Now Drives Over Half of AI Revenue as Amazon Pushes Trainium and Nova Ahead of re:Invent

Agents & Tools

AWS Says AI Inference Now Drives Over Half of AI Revenue as Amazon Pushes Trainium and Nova Ahead of re:Invent

With AWS running near a $182 billion annualised pace, leadership says inference now exceeds training revenue while capacity constraints fuel external Trai…

Clara Tan13 Nov

Apple Targets Local AI Developers With M6 14-Inch MacBook Pro Featuring Dual Neural Engines

Devices & Gadgets

Apple Targets Local AI Developers With M6 14-Inch MacBook Pro Featuring Dual Neural Engines

Now shipping across 35 countries starting at $1,999, Apple's 14-inch MacBook Pro with M6 packs GPU Neural Accelerators and 170GB/s memory bandwidth for lo…

Jin13 Nov

LMSYS Launches SGLang Inference Consortium With Nvidia, AMD, Intel, Google and Meta

Chips & Compute

LMSYS Launches SGLang Inference Consortium With Nvidia, AMD, Intel, Google and Meta

At the SGLang Summit in San Francisco, LMSYS Org formed the SGLang Consortium alongside major silicon and cloud providers to standardise open-source AI in…

Marcus Vance13 Nov

Inside Project QuiltWorks and the AI-Driven Vulnerability Storm

Breaches & Threats

Inside Project QuiltWorks and the AI-Driven Vulnerability Storm

The window between software creation and weaponized exploitation has effectively vanished, as the fastest eCrime breakout is now measured in seconds rathe…

Jin25 Apr

Google Gemma 4 Review: 5 Reasons Developers Are Switching (Apache 2.0 & Benchmarks)

Models & Research

Google Gemma 4 Review: 5 Reasons Developers Are Switching (Apache 2.0 & Benchmarks)

Why developers are switching to Google's open-weight Gemma 4 models: Apache 2.0 commercial licensing, native multimodal audio on edge devices, parameter s…

Jin7 Apr

Tags on this page

  • SGLang2
  • AI1
  • Amazon1
  • Amazon Nova1
  • AMD1
  • Anthropic1
  • Apple1
  • Apple Silicon1
  • Asia-tech1
  • AWS1
  • Bedrock1
  • Claude Mythos Preview1