Skip to main content

NVIDIA launches Dynamo 1.0 open source software for AI inference at scale

Source Decision Insights Record Published March 16, 2026 Companies 9
Human View Machine View

9 companies named across 8 categories, one of 410 articles referencing Nvidia. Previous coverage: NVIDIA introduces Physical AI Data Factory Blueprint to scale AI training data workflows (Mar 2026).

Companies mentioned

Best suited for

Seniority
EVP / SVP / VP / AVP
Job function
Chief Technology Officer
Persona
Platform / Infrastructure Architect
Buyer role
Architect / Technical Evaluator
Decision stage
Which to buy
Adoption curve
Early Majority
Technology maturity
Operational Expansion
Industry
Information Technology / Software & Services / IT Services / Cloud Services

Our classification, not the publisher's statement. Best suited for, not only for.

NVIDIA introduced Dynamo 1.0, an open source software platform intended to support inference operations at scale. This platform targets complex Artificial Intelligence (AI) workloads by coordinating graphical processing unit (GPU) and memory resources across clusters.

This initiative carries operational importance as it addresses the growing complexity of scaling inference workloads within data centers. Dynamo 1.0 acts as a distributed Operating System (OS) that manages resource orchestration amid varied and unpredictable AI requests.

The technology enables splitting inference processing across GPUs with enhanced traffic control and data movement between GPUs and cost-effective storage. It optimizes agentic AI and long prompt tasks by routing requests to GPUs with relevant short-term memory and offloading unused memory to improve resource efficiency.

Integration of Dynamo and NVIDIA TensorRT-LLM optimizations occurs natively within various open source frameworks such as LangChain, llm-d, LMCache, SGLang, and vLLM. Core components like KVBM for memory management and NVIDIA NIXL for data transfer support functionalities. NVIDIA also provides CUDA kernels for open source projects.

NVIDIA's inference platform is utilized by cloud service providers including Amazon Web Services, Microsoft Azure, Google Cloud, and Oracle Cloud Infrastructure. Cloud partners such as Alibaba Cloud and CoreWeave, AI-focused companies like Cursor and Perplexity, inference endpoint providers, and global enterprises such as ByteDance, PayPal, and Pinterest have adopted the platform.

Chen Goldberg of CoreWeave said, “As AI moves from experimental pilots to continuous, large-scale production, the underlying infrastructure must be as dynamic as the models it supports. Supporting NVIDIA Dynamo allows us to offer a more seamless, resilient environment for deploying complex AI agents.” Danila Shtan of Nebius said, “Delivering reliable AI inference at scale isn’t just about powerful GPUs, it’s about the software that turns that performance into real customer outcomes.” Matt Madrigal of Pinterest said, “With NVIDIA Dynamo optimizing our deployment, we’re expanding the seamless and personalized experiences we deliver, powered by high-performance AI infrastructure.” Vipul Ved Prakash of Together AI said, “NVIDIA Dynamo 1.0, combined with cutting-edge inference research from Together AI, helps us deliver a high-performance stack to offer accelerated, cost-effective inference for large-scale production workloads.”

Dynamo 1.0 is available worldwide as a production-ready solution for developers to integrate into their AI inference workflows.

Press release, provided by Globe Newswire on behalf of Nvidia. Read the original.

Mentions

Structured data (JSON-LD)

The schema.org markup this page publishes for search engines and AI agents, exactly as they read it.

[
  {
    "@context": "https://schema.org",
    "@id": "https://decisioninsights.ai/#website",
    "@type": "WebSite",
    "name": "Decision Insights",
    "potentialAction": {
      "@type": "SearchAction",
      "target": {
        "@type": "EntryPoint",
        "urlTemplate": "https://decisioninsights.ai/search/?q={search_term_string}&submit=1"
      }
    },
    "publisher": {
      "@id": "https://decisioninsights.ai/#organization"
    },
    "url": "https://decisioninsights.ai"
  },
  {
    "@context": "https://schema.org",
    "@id": "https://decisioninsights.ai/#organization",
    "@type": "Organization",
    "contactPoint": {
      "@type": "ContactPoint",
      "contactType": "customer support",
      "email": "[email protected]"
    },
    "description": "Decision Insights is a Registry of technology companies, open source projects, and industry terms, built for people and for AI agents that need sourced, structured information.",
    "logo": {
      "@type": "ImageObject",
      "url": "https://wiretap-cdn-assets.nyc3.cdn.digitaloceanspaces.com/decision-insights/[email protected]"
    },
    "name": "Decision Insights",
    "parentOrganization": {
      "@type": "Organization",
      "name": "Wiretap Labs",
      "sameAs": [
        "https://www.linkedin.com/company/wiretap-labs",
        "https://www.crunchbase.com/organization/wiretap-labs"
      ],
      "url": "https://wiretaplabs.com"
    },
    "publishingPrinciples": "https://decisioninsights.ai/standards/",
    "sameAs": [
      "https://www.linkedin.com/company/decisioninsights"
    ],
    "url": "https://decisioninsights.ai"
  },
  {
    "@context": "https://schema.org",
    "@type": "BreadcrumbList",
    "itemListElement": [
      {
        "@type": "ListItem",
        "item": "https://decisioninsights.ai",
        "name": "Decision Insights",
        "position": 1
      },
      {
        "@type": "ListItem",
        "item": "https://decisioninsights.ai/records/",
        "name": "Records",
        "position": 2
      },
      {
        "@type": "ListItem",
        "item": "https://decisioninsights.ai/nvidia-launches-dynamo-1.0-open-source-software-for-ai-inference-at-scale/",
        "name": "NVIDIA launches Dynamo 1.0 open source software for AI inference at scale",
        "position": 3
      }
    ]
  },
  {
    "@context": "https://schema.org",
    "@id": "https://decisioninsights.ai/nvidia-launches-dynamo-1.0-open-source-software-for-ai-inference-at-scale/#blogposting",
    "@type": "NewsArticle",
    "about": {
      "@id": "https://decisioninsights.ai/registry/nvidia-corp/#organization",
      "@type": "Organization",
      "mainEntityOfPage": "https://decisioninsights.ai/registry/nvidia-corp/",
      "name": "Nvidia"
    },
    "articleSection": [
      "Artificial Intelligence",
      "AI infrastructure",
      "Data Center"
    ],
    "audience": [
      {
        "@type": "Audience",
        "additionalType": "Seniority",
        "audienceType": "EVP / SVP / VP / AVP"
      },
      {
        "@type": "Audience",
        "additionalType": "Job function",
        "audienceType": "Chief Technology Officer"
      },
      {
        "@type": "Audience",
        "additionalType": "Persona",
        "audienceType": "Platform / Infrastructure Architect"
      },
      {
        "@type": "Audience",
        "additionalType": "Buyer role",
        "audienceType": "Architect / Technical Evaluator"
      },
      {
        "@type": "Audience",
        "additionalType": "Adoption curve",
        "audienceType": "Early Majority"
      },
      {
        "@type": "Audience",
        "additionalType": "Technology maturity",
        "audienceType": "Operational Expansion"
      },
      {
        "@type": "Audience",
        "additionalType": "Industry",
        "audienceType": "Information Technology / Software & Services / IT Services / Cloud Services"
      }
    ],
    "author": {
      "@id": "https://decisioninsights.ai/author/decision-insights-signals/#person",
      "@type": "Person",
      "name": "Decision Insights Record",
      "url": "https://decisioninsights.ai/author/decision-insights-signals/"
    },
    "dateModified": "2026-08-23T14:23:16-06:00",
    "datePublished": "2026-03-16T15:31:40-06:00",
    "description": "NVIDIA launched Dynamo 1.0, open source software enhancing AI inference performance and resource management on Blackwell GPUs at scale.",
    "headline": "NVIDIA launches Dynamo 1.0 open source software for AI inference at scale",
    "isBasedOn": {
      "@type": "CreativeWork",
      "sourceOrganization": {
        "@type": "Organization",
        "name": "GlobeNewswire"
      },
      "url": "https://www.globenewswire.com/news-release/2026/03/16/3256759/0/en/NVIDIA-Enters-Production-With-Dynamo-the-Broadly-Adopted-Inference-Operating-System-for-AI-Factories.html"
    },
    "keywords": [
      "Cloud",
      "Inference",
      "Open Source",
      "Operating System",
      "Software"
    ],
    "mainEntityOfPage": {
      "@id": "https://decisioninsights.ai/nvidia-launches-dynamo-1.0-open-source-software-for-ai-inference-at-scale/",
      "@type": "WebPage",
      "sdDatePublished": "2026-08-23",
      "sdPublisher": {
        "@id": "https://decisioninsights.ai/#organization"
      }
    },
    "mentions": [
      {
        "@id": "https://decisioninsights.ai/registry/alibaba-group-holding-limited/alibaba-cloud/#organization",
        "@type": "Organization",
        "mainEntityOfPage": "https://decisioninsights.ai/registry/alibaba-group-holding-limited/alibaba-cloud/",
        "name": "Alibaba Cloud"
      },
      {
        "@id": "https://decisioninsights.ai/registry/amazon.com/amazon-web-services-aws/#organization",
        "@type": "Organization",
        "mainEntityOfPage": "https://decisioninsights.ai/registry/amazon.com/amazon-web-services-aws/",
        "name": "Amazon Web Services (AWS)"
      },
      {
        "@id": "https://decisioninsights.ai/registry/spacex/cursor/#organization",
        "@type": "Organization",
        "mainEntityOfPage": "https://decisioninsights.ai/registry/spacex/cursor/",
        "name": "Anysphere, Inc."
      },
      {
        "@id": "https://decisioninsights.ai/registry/coreweave/#organization",
        "@type": "Organization",
        "mainEntityOfPage": "https://decisioninsights.ai/registry/coreweave/",
        "name": "CoreWeave"
      },
      {
        "@id": "https://decisioninsights.ai/registry/google-cloud-platform-gcp/#organization",
        "@type": "Organization",
        "mainEntityOfPage": "https://decisioninsights.ai/registry/google-cloud-platform-gcp/",
        "name": "Google Cloud Platform (GCP)"
      },
      {
        "@id": "https://decisioninsights.ai/registry/microsoft/#organization",
        "@type": "Organization",
        "mainEntityOfPage": "https://decisioninsights.ai/registry/microsoft/",
        "name": "Microsoft"
      },
      {
        "@id": "https://decisioninsights.ai/registry/nebius/#organization",
        "@type": "Organization",
        "mainEntityOfPage": "https://decisioninsights.ai/registry/nebius/",
        "name": "Nebius"
      },
      {
        "@id": "https://decisioninsights.ai/registry/nvidia-corp/#organization",
        "@type": "Organization",
        "mainEntityOfPage": "https://decisioninsights.ai/registry/nvidia-corp/",
        "name": "Nvidia"
      },
      {
        "@id": "https://decisioninsights.ai/registry/dyn-wine0q/#organization",
        "@type": "Organization",
        "mainEntityOfPage": "https://decisioninsights.ai/registry/dyn-wine0q/",
        "name": "Oracle"
      },
      {
        "@id": "https://decisioninsights.ai/projects/sglang/#project",
        "@type": "SoftwareSourceCode",
        "mainEntityOfPage": "https://decisioninsights.ai/projects/sglang/",
        "name": "SGLang"
      },
      {
        "@id": "https://decisioninsights.ai/projects/tensorrt-llm/#project",
        "@type": "SoftwareSourceCode",
        "mainEntityOfPage": "https://decisioninsights.ai/projects/tensorrt-llm/",
        "name": "TensorRT-LLM"
      },
      {
        "@id": "https://decisioninsights.ai/projects/vllm/#project",
        "@type": "SoftwareSourceCode",
        "mainEntityOfPage": "https://decisioninsights.ai/projects/vllm/",
        "name": "vLLM"
      }
    ],
    "publisher": {
      "@id": "https://decisioninsights.ai/#organization"
    }
  },
  {
    "@context": "https://schema.org",
    "@id": "https://decisioninsights.ai/author/decision-insights-signals/#person",
    "@type": "Person",
    "description": "Press releases and independent analyst research, structured into concise summaries for research and monitoring. Produced under our Standards & Methodology.",
    "name": "Decision Insights Record",
    "sameAs": [
      "https://www.linkedin.com/showcase/decisioninsights/"
    ],
    "url": "https://decisioninsights.ai/author/decision-insights-signals/"
  }
]

Is this your company? Get structured data for your own pages