Best Small LLM AI models (2026)

Our top 5 Small LLM models, ordered by how recently they were released and their context window. See all 5 Small LLM models.

1
G
Small LLM

1M ctx · $0.07/$0.30 per 1M · Google

Gemini 1.5 Flash is a small, fast, and low-cost multimodal LLM from Google, designed for high-throughput tasks. It excel...

View details Visit
2
C
Small LLM

200K ctx · $0.80/$4 per 1M · Anthropic

Claude 3.5 Haiku is Anthropic's fastest, low-cost model designed for latency-sensitive and high-volume workloads. It is ...

View details Visit
3
G
Small LLM

128K ctx · $0.15/$0.60 per 1M · OpenAI

GPT-4o mini is a smaller, low-cost OpenAI model designed for high-volume tasks. It supports both text and vision inputs,...

View details Visit
4
L

Llama 3.1 8B

Open weights
Small LLM

128K ctx · Meta

Llama 3.1 8B is a small, open-weights language model from Meta designed for efficiency on modest hardware, such as on-de...

View details Visit
5
M

Mistral Small

Open weights
Small LLM

32K ctx · $0.20/$0.60 per 1M · Mistral AI

Mistral Small is a compact, cost-efficient language model released by Mistral AI under the Apache 2.0 license. It is des...

View details Visit