Open SourceLibraryFree
vLLM
High-throughput local LLM inference and serving engine.
Alternatives
4 workflows use vLLM
Local InferenceFreeMachine-verified
Serve MiniMax M3 yourself for agentic coding (vLLM)
Stand up MiniMax M3 on an 8x H200 node as an OpenAI-compatible endpoint and point any coding agent at it, validated serve flags + endpoint config.
MiniMax M3vLLM· advanced
AgentsFreeLocal hardware
Fine-Tune an Open LLM to Make It Yours
Adapt an open-weight model to your domain with a small dataset.
vLLM· advanced
Local InferenceFreeMachine-verified
Serve GLM-5.1 yourself for long-horizon agentic coding (vLLM)
Stand up the MIT-licensed GLM-5.1 FP8 checkpoint as an OpenAI-compatible endpoint for long agentic runs, validated serve config + endpoint.
GLM-5.2vLLM· advanced
Local InferenceFreeMachine-verified
Serve NVIDIA Nemotron 3 Ultra yourself for high-throughput agents (vLLM)
Stand up the NVFP4 Nemotron 3 Ultra checkpoint as an OpenAI-compatible endpoint for fast, long-running agent loops, validated serve flags + endpoint.
NVIDIA Nemotron 3 UltravLLM· advanced