Skip to main content

Solo.io Launches MCP Gateway for AI Tool Integration in Cloud Native Applications

April 3, 2025

Open source Model Context Protocol (MCP) gateway provides advanced security, tool federation, and streamlined development for Artificial Intelligence (AI) teams integrating MCP-compatible tools with AI agents.

Solo.Inference Orchestrator (IO) announced MCP Gateway, a MCP gateway, designed to streamline the integration and governance of AI agents with MCP-compatible toolchains. This initiative responds to the growing demand for effective management and security of traffic arising from AI workloads in cloud native applications.

Organizations utilizing kgateway, including Domino’s Pizza, ParkMobile, and Vonage, already benefit from its capabilities related to Application Programming Interface (API) traffic management, resilience, and security. The introduction of MCP Gateway allows for the deployment of advanced AI gateway use cases, enhancing traffic management for interactions with Large Language Model (LLM) providers.

MCP, created by Anthropic, establishes a standardized method for connecting LLMs to various data sources and tools. As this protocol gains traction among diverse technologies, it aims to reduce the complexity associated with the integration process for AI clients and agents.

“While MCP has rapidly emerged as the de facto standard protocol for accessing tools from agents, building MCP integration capabilities into every application client and agent is error-prone and cumbersome for AI development teams,” said Keith Babo, Chief Product Officer, Solo.IO. “MCP Gateway eliminates the need to manually connect these agents and tools by consolidating MCP servers into one place, saving teams countless hours and eliminating undifferentiated heavy lifting.”

Key features of MCP Gateway include:

  • Simplification of tool onboarding via automated discovery and registration of MCP tool servers.
  • Centralized registry for MCP tools across various tool servers.
  • Single endpoint access for any MCP tool through innovative MCP multiplexing.
  • Enhanced security for MCP tool server implementations to manage multi-tenant consumption.
  • Centralized metrics, logging, and tracing for tool call observability.

MCP Gateway is an open source project under the Cloud Native Computing Foundation and part of kgateway.

Related Perspectives