0 alternative definitions
A middleware layer that manages request flows between applications and AI models by routing, securing, and monitoring them.