Merlin

Community for Merlin engine: A vLLM tuned fork for NVIDIA Ampere, GA100 and Ada cards, running 7+ models at their full context sizes, KV RAM cache and much more! One command install.