0 alternative definitions
An optimization mechanism that stores previous model responses and retrieves them by semantic similarity between queries, rather than exact matching, to reduce redundant computation, cost, and latency.
