7d ago · MarkTechPost →
Buoyant has released Kinference, an Apache 2.0 inference control plane for vLLM on Kubernetes.