Intermediate · Cognitive
Episodic memory
Visual diagram · (in preparation) · Math · (in preparation) · Worked example · 3 difficulty levels.
TL;DR. In LLMs, information learned or retained by the model after its initial training period.
Technical Definition
In LLMs, information learned or retained by the model after its initial training period.
How it works
Episodic memory in LLMs refers to the ability of the model to retain and recall information from specific past interactions or experiences that occurred after its main training phase. This is distinct from semantic memory, which is the general knowledge acquired during training. Episodic memory can be temporary, like remembering a conversation within a single session.
Related Concepts
- Large Language Model (LLM) — A massive neural network trained on vast text corpora to understand and generate human language with remarkable fluency.
- Context Window — The maximum number of tokens a model can process in a single input, determining information capacity.