Top 12 LiteRT alternatives

LiteRT-LM is a lightweight, cross-platform inference framework designed for efficiently running Large Language Mode…

LMCache is a high-performance key-value (KV) cache layer designed to optimize and accelerate large language model (…

LocalAI is a self-hosted, open-source alternative to the OpenAI API, providing a REST API for running AI models loc…

MindsDB is an open-source platform that integrates machine learning models directly into databases, enabling users …

mini-sglang is a lightweight framework designed for efficient deployment and serving of large language models (LLMs…

MLRun is an open-source MLOps framework designed to streamline the deployment and management of machine learning wo…

MLServer is an open-source inference server designed for deploying and serving machine learning models, supporting …

Model Runner is a Docker-based tool for deploying and serving AI models, including LLMs, by containerizing them for…

Mosec is a Rust-powered, multi-stage pipelined model server designed for efficient AI model deployment. It supports…

nndeploy is an open-source framework designed to simplify the deployment of AI models by providing a high-performan…

Nuclio is a high-performance serverless platform designed for deploying and managing data, I/O, and compute-intensi…

OpenVINO (Open Visual Inference and Neural Network Optimization) is an open-source toolkit designed to optimize and…