Inference Orchestrator
Inference orchestrator is software that coordinates and manages how applications invoke one or more AI or machine learning inference services, providing a control layer for routing, composition, observability, and policy enforcement in enterprise AI and data architectures.