Skip to main content

April 3, 2025

Supermicro's NVIDIA B200 systems show performance gains on MLPerf Inference v5.0

Summary

Supermicro reported strong performance for its NVIDIA HGX B200 systems on several MLPerf Inference v5.0 benchmarks. The company demonstrated over three times the token generation compared to prior systems, indicating advancement in Artificial Intelligence (AI) capabilities.

Charles Liang, president and CEO of Supermicro, stated, “Supermicro remains a leader in the AI industry, as evidenced by the first new benchmarks released by MLCommons in 2025. Our building block architecture enables us to be first-to-market with a diverse range of systems optimized for various workloads. We continue to collaborate closely with NVIDIA to fine-tune our systems and secure a leadership position in AI workloads.”

Supermicro optimized its air-cooled and liquid-cooled NVIDIA HGX B200 systems for peak performance before the benchmarking. Both variations achieved comparable performance within their operating margins. These optimizations allowed the systems to reach over 1,000 tokens per second for large model inferences, notably outperforming earlier generations.

The SYS-421GE-NBRT-LCC and SYS-A21GE-NBRT systems reached remarkable performance scores on frameworks such as Mixtral and Llama3.1. MLCommons acknowledged Supermicro for the performance gains compared to previous models, stating, “Customers will be pleased by the performance improvements achieved which are validated by the neutral, representative, and reproducible MLPerf results.”

In summary, Supermicro's B200 systems are presenting notable advancements in inference performance on MLPerf benchmarks, with over 100 GPU-optimized models. The company's commitment to enhancing AI performance reflects its ongoing collaboration with NVIDIA.

Our summary. The original keeps its own byline.

Companies in this article

Topics

Mentions

Structured data (JSON-LD)

The schema.org markup this page publishes for search engines and AI agents, exactly as they read it.

[
  {
    "@context": "https://schema.org",
    "@id": "https://decisioninsights.ai/#website",
    "@type": "WebSite",
    "name": "Decision Insights",
    "potentialAction": {
      "@type": "SearchAction",
      "target": {
        "@type": "EntryPoint",
        "urlTemplate": "https://decisioninsights.ai/search/?q={search_term_string}&submit=1"
      }
    },
    "publisher": {
      "@id": "https://decisioninsights.ai/#organization"
    },
    "url": "https://decisioninsights.ai"
  },
  {
    "@context": "https://schema.org",
    "@id": "https://decisioninsights.ai/#organization",
    "@type": "Organization",
    "contactPoint": {
      "@type": "ContactPoint",
      "contactType": "customer support",
      "email": "[email protected]"
    },
    "description": "Decision Insights is a Registry of technology companies, open source projects, and industry terms, built for people and for AI agents that need sourced, structured information.",
    "legalName": "Wiretap Labs, LLC",
    "logo": {
      "@type": "ImageObject",
      "url": "https://wiretap-cdn-assets.nyc3.cdn.digitaloceanspaces.com/decision-insights/[email protected]"
    },
    "name": "Decision Insights",
    "parentOrganization": {
      "@type": "Organization",
      "name": "Wiretap Labs",
      "sameAs": [
        "https://www.linkedin.com/company/wiretap-labs",
        "https://www.crunchbase.com/organization/wiretap-labs"
      ],
      "url": "https://wiretaplabs.com"
    },
    "publishingPrinciples": "https://decisioninsights.ai/standards/",
    "sameAs": [
      "https://www.linkedin.com/company/decisioninsights"
    ],
    "url": "https://decisioninsights.ai"
  },
  {
    "@context": "https://schema.org",
    "@type": "BreadcrumbList",
    "itemListElement": [
      {
        "@type": "ListItem",
        "item": "https://decisioninsights.ai",
        "name": "Decision Insights",
        "position": 1
      },
      {
        "@type": "ListItem",
        "item": "https://decisioninsights.ai/records/",
        "name": "Records",
        "position": 2
      },
      {
        "@type": "ListItem",
        "item": "https://decisioninsights.ai/supermicros-nvidia-b200-systems-show-performance-gains-on-mlperf-inference-v5-0/",
        "name": "Supermicro's NVIDIA B200 systems show performance gains on MLPerf Inference v5.0",
        "position": 3
      }
    ]
  },
  {
    "@context": "https://schema.org",
    "@id": "https://decisioninsights.ai/supermicros-nvidia-b200-systems-show-performance-gains-on-mlperf-inference-v5-0/#blogposting",
    "@type": "BlogPosting",
    "about": {
      "@id": "https://decisioninsights.ai/registry/supermicro/#organization",
      "@type": "Organization",
      "mainEntityOfPage": "https://decisioninsights.ai/registry/supermicro/",
      "name": "Supermicro"
    },
    "articleSection": [
      "Artificial Intelligence",
      "AI infrastructure",
      "Data Center"
    ],
    "author": {
      "@id": "https://decisioninsights.ai/author/decision-insights-signals/#person",
      "@type": "Person",
      "name": "Decision Insights Record",
      "url": "https://decisioninsights.ai/author/decision-insights-signals/"
    },
    "dateModified": "2026-08-23T15:01:55-06:00",
    "datePublished": "2025-04-03T09:56:58-06:00",
    "description": "Supermicro's NVIDIA B200 systems reported over three times the token generation on MLPerf Inference v5.0 benchmarks, showcasing AI performance.",
    "headline": "Supermicro's NVIDIA B200 systems show performance gains on MLPerf Inference v5.0",
    "keywords": [
      "Inference"
    ],
    "mainEntityOfPage": {
      "@id": "https://decisioninsights.ai/supermicros-nvidia-b200-systems-show-performance-gains-on-mlperf-inference-v5-0/",
      "@type": "WebPage",
      "sdDatePublished": "2026-08-23",
      "sdPublisher": {
        "@id": "https://decisioninsights.ai/#organization"
      }
    },
    "mentions": [
      {
        "@id": "https://decisioninsights.ai/registry/mlcommons/#organization",
        "@type": "Organization",
        "mainEntityOfPage": "https://decisioninsights.ai/registry/mlcommons/",
        "name": "MLCommons"
      },
      {
        "@id": "https://decisioninsights.ai/registry/nvidia-corp/#organization",
        "@type": "Organization",
        "mainEntityOfPage": "https://decisioninsights.ai/registry/nvidia-corp/",
        "name": "Nvidia"
      },
      {
        "@id": "https://decisioninsights.ai/registry/supermicro/#organization",
        "@type": "Organization",
        "mainEntityOfPage": "https://decisioninsights.ai/registry/supermicro/",
        "name": "Supermicro"
      }
    ],
    "publisher": {
      "@id": "https://decisioninsights.ai/#organization"
    }
  },
  {
    "@context": "https://schema.org",
    "@id": "https://decisioninsights.ai/author/decision-insights-signals/#person",
    "@type": "Person",
    "description": "Press releases and independent analyst research, structured into concise summaries for research and monitoring. Produced under our Standards & Methodology.",
    "name": "Decision Insights Record",
    "sameAs": [
      "https://www.linkedin.com/showcase/decisioninsights/"
    ],
    "url": "https://decisioninsights.ai/author/decision-insights-signals/"
  }
]

Is this your company? Get structured data for your own pages