Tag: #vLLM
Search Results
Technologyarticle
Tunix: Google's New Library for High-Throughput Agentic RL
#Tunix#Google#Agentic RL#GRPO#vLLM#JAX#TPU
Technologyarticle
Run Ray on TPU, Part 2: Ray Serve, Ray Data, and Ray Train
#Ray#TPU#GKE#vLLM#JAX#Anyscale
Technologyarticle
Netflix's In-House LLM Stack: Engine, Packaging, API, Rollout
#Netflix#LLM Serving#Triton#vLLM#TensorRT-LLM#MSS
Technologyarticle
Netflix Builds In-House LLM Serving Platform with vLLM and Triton
#Netflix#LLM#vLLM#NVIDIA Triton#AI Infrastructure#Machine Learning
AIarticle
How Netflix Scaled In-House LLM Serving with vLLM and Triton
#Netflix Engineering#vLLM#Triton Inference Server#Machine Learning Infrastructure