recipes.vllm.ai

vLLM Recipes — Deploy any model on any hardware with vLLM

How do I run model X on hardware Y? Pick a model, get a working vllm serve command.