Xinference

Xinference is a powerful, open-source inference framework designed to help developers and enterprises deploy and manage any AI model with ease. Whether you’re running LLMs, speech, or multimodal models on the cloud, on-prem, or even your laptop, Xinference gives you total control.