Intermediate · NLP
Small Language Models (SLMs)
Visual diagram · (in preparation) · Math · (in preparation) · Worked example · 3 difficulty levels.
TL;DR. Compact language models that run efficiently on-premise, on edge devices, or on a laptop.
Technical Definition
Compact language models that run efficiently on-premise, on edge devices, or on a laptop.
How it works
Small Language Models (SLMs) — typically ranging from a few hundred million to around 10 billion parameters — are designed to run on company servers, edge hardware, or even a single laptop. They trade some raw capability for lower cost, latency, and better privacy. In 2026 SLMs underpin 'privacy by design' deployments: the model and prompts never leave the device or corporate perimeter, which strengthens confidentiality and simplifies compliance. Examples include Phi, Gemma, and Llama-family small variants.
Related Concepts
- Large Language Model (LLM) — A massive neural network trained on vast text corpora to understand and generate human language with remarkable fluency.
- Edge AI — Running AI models directly on user devices instead of cloud servers.
- Sovereign AI — Building and operating in-house AI infrastructure and models to keep full control of data and reduce dependence on hyperscalers.