OpenLLM

Q: What is OpenLLM?

OpenLLM is an open-source framework for serving and managing open-source large language models in production environments.

Human View Machine View

This is the page you're already on — the Human View toggle above shows it in full.

A green key on the record, left, is one Decision Insights added. It doesn't exist on the company's site or in a wire feed. The same key labels its row on the right, so you can match them directly. More on how DI enriches a record.

The record

This is what the machine sees: the exact JSON-LD an agent receives for this listing.

WebSite

{
  "@context": "https://schema.org",
  "@id": "https://decisioninsights.ai/#website",
  "@type": "WebSite",
  "name": "Decision Insights",
  "potentialAction": {
    "@type": "SearchAction",
    "target": {
      "@type": "EntryPoint",
      "urlTemplate": "https://decisioninsights.ai/search/?q={search_term_string}\u0026submit=1"
    }
  },
  "publisher": {
    "@id": "https://decisioninsights.ai/#organization"
  },
  "url": "https://decisioninsights.ai"
}

Organization

{
  "@context": "https://schema.org",
  "@id": "https://decisioninsights.ai/#organization",
  "@type": "Organization",
  "contactPoint": {
    "@type": "ContactPoint",
    "contactType": "customer support",
    "email": "[email protected]"
  },
  "description": "Decision Insights is a Registry of technology companies, open source projects, and industry terms, built for people and for AI agents that need sourced, structured information.",
  "logo": {
    "@type": "ImageObject",
    "url": "https://wiretap-cdn-assets.nyc3.cdn.digitaloceanspaces.com/decision-insights/[email protected]"
  },
  "name": "Decision Insights",
  "parentOrganization": {
    "@type": "Organization",
    "name": "Wiretap Labs",
    "sameAs": [
      "https://www.linkedin.com/company/wiretap-labs",
      "https://www.crunchbase.com/organization/wiretap-labs"
    ],
    "url": "https://wiretaplabs.com"
  },
  "publishingPrinciples": "https://decisioninsights.ai/standards/",
  "sameAs": [
    "https://www.linkedin.com/company/decisioninsights"
  ],
  "url": "https://decisioninsights.ai"
}

BreadcrumbList

{
  "@context": "https://schema.org",
  "@type": "BreadcrumbList",
  "itemListElement": [
    {
      "@type": "ListItem",
      "item": "https://decisioninsights.ai",
      "name": "Decision Insights",
      "position": 1
    },
    {
      "@type": "ListItem",
      "item": "https://decisioninsights.ai/registry/",
      "name": "Registry",
      "position": 2
    },
    {
      "@type": "ListItem",
      "item": "https://decisioninsights.ai/projects/",
      "name": "Projects",
      "position": 3
    },
    {
      "@type": "ListItem",
      "item": "https://decisioninsights.ai/registry/bentoml/",
      "name": "BentoML",
      "position": 4
    },
    {
      "@type": "ListItem",
      "item": "https://decisioninsights.ai/projects/openllm/",
      "name": "OpenLLM",
      "position": 5
    }
  ]
}

SoftwareSourceCode

{
  "@context": "https://schema.org",
  "@id": "https://decisioninsights.ai/projects/openllm/#project",
  "@type": "SoftwareSourceCode",
  "additionalProperty": [
    {
      "@type": "PropertyValue",
      "name": "Related projects",
      "propertyID": "https://decisioninsights.ai/ns#relatedProjects",
      "value": [
        {
          "@id": "https://decisioninsights.ai/projects/vllm/#project",
          "@type": "SoftwareSourceCode",
          "mainEntityOfPage": "https://decisioninsights.ai/projects/vllm/",
          "name": "vLLM"
        },
        {
          "@id": "https://decisioninsights.ai/projects/stablelm/#project",
          "@type": "SoftwareSourceCode",
          "mainEntityOfPage": "https://decisioninsights.ai/projects/stablelm/",
          "name": "StableLM"
        },
        {
          "@id": "https://decisioninsights.ai/projects/bentoml/#project",
          "@type": "SoftwareSourceCode",
          "mainEntityOfPage": "https://decisioninsights.ai/projects/bentoml/",
          "name": "BentoML"
        },
        {
          "@id": "https://decisioninsights.ai/projects/openlso/#project",
          "@type": "SoftwareSourceCode",
          "mainEntityOfPage": "https://decisioninsights.ai/projects/openlso/",
          "name": "OpenLSO"
        },
        {
          "@id": "https://decisioninsights.ai/projects/sglang/#project",
          "@type": "SoftwareSourceCode",
          "mainEntityOfPage": "https://decisioninsights.ai/projects/sglang/",
          "name": "SGLang"
        },
        {
          "@id": "https://decisioninsights.ai/projects/mlrun/#project",
          "@type": "SoftwareSourceCode",
          "mainEntityOfPage": "https://decisioninsights.ai/projects/mlrun/",
          "name": "MLRun"
        },
        {
          "@id": "https://decisioninsights.ai/projects/llm-guard/#project",
          "@type": "SoftwareSourceCode",
          "mainEntityOfPage": "https://decisioninsights.ai/projects/llm-guard/",
          "name": "LLM Guard"
        },
        {
          "@id": "https://decisioninsights.ai/projects/bloom-oss-project/#project",
          "@type": "SoftwareSourceCode",
          "mainEntityOfPage": "https://decisioninsights.ai/projects/bloom-oss-project/",
          "name": "BLOOM (OSS Project)"
        }
      ]
    },
    {
      "@type": "PropertyValue",
      "name": "Related organizations",
      "propertyID": "https://decisioninsights.ai/ns#relatedOrganizations",
      "value": [
        {
          "@id": "https://decisioninsights.ai/registry/deepseek/#organization",
          "@type": "Organization",
          "mainEntityOfPage": "https://decisioninsights.ai/registry/deepseek/",
          "name": "DeepSeek"
        },
        {
          "@id": "https://decisioninsights.ai/registry/mistral-ai/#organization",
          "@type": "Organization",
          "mainEntityOfPage": "https://decisioninsights.ai/registry/mistral-ai/",
          "name": "Mistral AI"
        },
        {
          "@id": "https://decisioninsights.ai/registry/abacus.ai-inc./#organization",
          "@type": "Organization",
          "mainEntityOfPage": "https://decisioninsights.ai/registry/abacus.ai-inc./",
          "name": "Abacus.AI, Inc."
        },
        {
          "@id": "https://decisioninsights.ai/registry/zenml/#organization",
          "@type": "Organization",
          "mainEntityOfPage": "https://decisioninsights.ai/registry/zenml/",
          "name": "ZenML"
        },
        {
          "@id": "https://decisioninsights.ai/registry/voltage-park/#organization",
          "@type": "Organization",
          "mainEntityOfPage": "https://decisioninsights.ai/registry/voltage-park/",
          "name": "Voltage Park"
        },
        {
          "@id": "https://decisioninsights.ai/registry/clearml/#organization",
          "@type": "Organization",
          "mainEntityOfPage": "https://decisioninsights.ai/registry/clearml/",
          "name": "ClearML"
        },
        {
          "@id": "https://decisioninsights.ai/registry/aioni-solutions/#organization",
          "@type": "Organization",
          "mainEntityOfPage": "https://decisioninsights.ai/registry/aioni-solutions/",
          "name": "Aioni Solutions"
        },
        {
          "@id": "https://decisioninsights.ai/registry/comet/#organization",
          "@type": "Organization",
          "mainEntityOfPage": "https://decisioninsights.ai/registry/comet/",
          "name": "Comet ML, Inc."
        }
      ]
    }
  ],
  "author": {
    "@id": "https://decisioninsights.ai/registry/bentoml/#organization",
    "@type": "Organization",
    "mainEntityOfPage": "https://decisioninsights.ai/registry/bentoml/",
    "name": "BentoML"
  },
  "codeRepository": "https://github.com/bentoml/openllm",
  "dateModified": "2026-08-27T03:10:34Z",
  "description": "OpenLLM is an open-source framework for serving and managing open-source large language models in production environments.",
  "keywords": [
    "Open Source",
    "Application",
    "Command-Line Interface",
    "Continuous Integration and Continuous Deployment",
    "Inference",
    "Language Models",
    "Machine Learning",
    "Machine Learning Operations",
    "Model Serving",
    "Observability",
    "Open Source",
    "Orchestration",
    "Services"
  ],
  "knowsAbout": [
    {
      "@id": "https://decisioninsights.ai/term/application/#definedterm",
      "@type": "DefinedTerm",
      "mainEntityOfPage": "https://decisioninsights.ai/term/application/",
      "name": "Application"
    },
    {
      "@id": "https://decisioninsights.ai/term/command-line-interface-cli/#definedterm",
      "@type": "DefinedTerm",
      "mainEntityOfPage": "https://decisioninsights.ai/term/command-line-interface-cli/",
      "name": "Command-Line Interface"
    },
    {
      "@id": "https://decisioninsights.ai/term/continuous-integration-and-continuous-deployment-cicd/#definedterm",
      "@type": "DefinedTerm",
      "mainEntityOfPage": "https://decisioninsights.ai/term/continuous-integration-and-continuous-deployment-cicd/",
      "name": "Continuous Integration and Continuous Deployment"
    },
    {
      "@id": "https://decisioninsights.ai/term/inference/#definedterm",
      "@type": "DefinedTerm",
      "mainEntityOfPage": "https://decisioninsights.ai/term/inference/",
      "name": "Inference"
    },
    {
      "@id": "https://decisioninsights.ai/term/language-models/#definedterm",
      "@type": "DefinedTerm",
      "mainEntityOfPage": "https://decisioninsights.ai/term/language-models/",
      "name": "Language Models"
    },
    {
      "@id": "https://decisioninsights.ai/term/machine-learning-ml/#definedterm",
      "@type": "DefinedTerm",
      "mainEntityOfPage": "https://decisioninsights.ai/term/machine-learning-ml/",
      "name": "Machine Learning"
    },
    {
      "@id": "https://decisioninsights.ai/term/machine-learning-operations-mlops/#definedterm",
      "@type": "DefinedTerm",
      "mainEntityOfPage": "https://decisioninsights.ai/term/machine-learning-operations-mlops/",
      "name": "Machine Learning Operations"
    },
    {
      "@id": "https://decisioninsights.ai/term/model-serving/#definedterm",
      "@type": "DefinedTerm",
      "mainEntityOfPage": "https://decisioninsights.ai/term/model-serving/",
      "name": "Model Serving"
    },
    {
      "@id": "https://decisioninsights.ai/term/observability/#definedterm",
      "@type": "DefinedTerm",
      "mainEntityOfPage": "https://decisioninsights.ai/term/observability/",
      "name": "Observability"
    },
    {
      "@id": "https://decisioninsights.ai/term/open-source/#definedterm",
      "@type": "DefinedTerm",
      "mainEntityOfPage": "https://decisioninsights.ai/term/open-source/",
      "name": "Open Source"
    },
    {
      "@id": "https://decisioninsights.ai/term/orchestration/#definedterm",
      "@type": "DefinedTerm",
      "mainEntityOfPage": "https://decisioninsights.ai/term/orchestration/",
      "name": "Orchestration"
    },
    {
      "@id": "https://decisioninsights.ai/term/services/#definedterm",
      "@type": "DefinedTerm",
      "mainEntityOfPage": "https://decisioninsights.ai/term/services/",
      "name": "Services"
    }
  ],
  "mainEntityOfPage": "https://decisioninsights.ai/projects/openllm/",
  "maintainer": {
    "@id": "https://decisioninsights.ai/registry/bentoml/#organization",
    "@type": "Organization",
    "mainEntityOfPage": "https://decisioninsights.ai/registry/bentoml/",
    "name": "BentoML"
  },
  "name": "OpenLLM",
  "publisher": {
    "@id": "https://decisioninsights.ai/registry/bentoml/#organization",
    "@type": "Organization",
    "mainEntityOfPage": "https://decisioninsights.ai/registry/bentoml/",
    "name": "BentoML"
  },
  "url": "https://github.com/bentoml/openllm"
}

What we add

Topic graph

A wire service tags a release with a category, once. It doesn't maintain a durable graph over time. We connect them to a topic graph an agent can query.

Application https://decisioninsights.ai/term/application/ Command-Line Interface https://decisioninsights.ai/term/command-line-interface-cli/ Continuous Integration and Continuous Deployment https://decisioninsights.ai/term/continuous-integration-and-continuous-deployment-cicd/ and 9 more

Counted facts

A protocol or open source project keeps no vendor list and publishes no figures of its own to check this against. This counts how it actually shows up across the graph -- articles that name it, the organizations named alongside it in those articles, similar projects, and organizations whose topic tags overlap with its own -- computed, not curated.

Related projects vLLM, StableLM, BentoML, OpenLSO, SGLang, MLRun, LLM Guard, BLOOM (OSS Project) Related organizations DeepSeek, Mistral AI, Abacus.AI, Inc., ZenML, Voltage Park, ClearML, Aioni Solutions, Comet ML, Inc.