GridNexa
github8h ago

Open source: vLLM tuning recipes for H100 clusters

Continuous batching, KV-cache quantization, and multi-node tensor parallel configs measured on GridNexa GPU Cloud.

This note summarizes reproducible vLLM flags for H100 clusters during Platform Preview.

vLLMH100OSS
COMMENTSComments 64
Sign in with Grid ID to join · press