Published event
Hardware
SecurityIncident
1 source(s)
v0.16.0
Summary
v0.16.0 vllm-project / vllm Public Uh oh! There was an error while loading.
Why it matters
This SecurityIncident is relevant to the technology intelligence record because it involves DeepSeek, Mistral AI, NVIDIA, AMD. The source article should remain the factual reference for follow-up coverage.
Key facts
- vllm-project / vllm Public Uh oh!
- There was an error while loading.
- Notifications You must be signed in to change notification settings Fork 22.7k Star 92.7k v0.16.0 khluu released this 25 Feb 19:58 · 8273 commits to main since this release v0.16.0 89a77b1 vLLM v0.16.0 Please note that this release was branch cut on Feb 8, so any features added to vLLM after that date is not included.
- Highlights This release features 440 commits from 203 contributors (7 new)!
- Async scheduling + Pipeline Parallelism is now fully supported, delivering 30.8% E2E throughput improvement and 31.8% TPOT improvement ( #32618 ).
- Realtime API : A new WebSocket-based Realtime API enables streaming audio interactions ( #33187 ), building on the Voxtral realtime infrastructure.
Entities in this story
Technologies
CUDA→Related events