AI Squawk the real-time terminal for AI news

↗

RELEASE Google Cloud Ships llm-d 1.0 With Cache-Aware Routing for TPU and GPU Fleets

Google, Red Hat and IBM released llm-d 1.0, an open-source Kubernetes-native stack for distributed LLM inference.

Source tier 3: +10
Category RELEASE: +30
Other adjustment (same-source burst decay, or scored under an earlier weighting): −5
Base score: 35
Velocity (0 corroborating sources): +0
Model mention: not accelerating vs. the prior week, no velocity bonus
Age decay (24d since published): −35
Effective score right now: 0