Skip to main content

MLCommons Releases MLPerf Inference v5.1 Benchmark Suite

Source Decision Insights Record Published September 9, 2025 Companies 2
Human View Machine View

2 companies named across 5 categories, one of 2 articles referencing MLCommons. Previous coverage: Supermicro's NVIDIA B200 systems show performance gains on MLPerf Inference v5.0 (Apr 2025).

Companies mentioned

Best suited for

Decision stage
Which to buy
Adoption curve
Early Adopters

Our classification, not the publisher's statement. Best suited for, not only for.

MLCommons® announced the release of its MLPerf® Inference v5.1 benchmark suite, which recorded a total of 27 organizations submitting systems for evaluation. This latest suite features three new benchmarks aimed at measuring Artificial Intelligence (AI) performance against contemporary workloads, reflecting advancements in hardware and software.

The MLPerf Inference benchmark suite is an open-source, industry-standard tool that assesses the speed at which AI models operate across various tasks. The recent results reveal notable enhancements in system capabilities, with some submitting participants demonstrating performance gains up to 50% compared to the previous 5.0 release.

Scott Wasson, Director of Product Management at MLCommons, stated, “The pace of innovation in AI is breathtaking.” He emphasized the introduction of new benchmarks, including DeepSeek-R1, which focuses on reasoning tasks, and updates to existing models like Large Language Model Meta AI (LLaMA) 3.1 8B, designed for text summarization.

This release marks a noteworthy increase in submissions, with several new processors evaluated. Among the enhancements is a heterogeneous system that allows for workload distribution across different accelerators, showcasing the evolving landscape in AI performance measurement. The benchmarks are crucial for organizations assessing AI systems for practical deployment.

New benchmarks within the suite include DeepSeek-R1, targeted at reasoning tasks, LLaMA 3.1 8B, which updates a prior model for better performance, and Whisper Large V3, addressing speech recognition tasks. These introductions follow community demand for comprehensive performance assessments under varying conditions, particularly for real-world applications requiring speed and accuracy.

Press release, provided by Globe Newswire on behalf of MLCommons. Read the original.

Mentions

Structured data (JSON-LD)

The schema.org markup this page publishes for search engines and AI agents, exactly as they read it.

[
  {
    "@context": "https://schema.org",
    "@id": "https://decisioninsights.ai/#website",
    "@type": "WebSite",
    "name": "Decision Insights",
    "potentialAction": {
      "@type": "SearchAction",
      "target": {
        "@type": "EntryPoint",
        "urlTemplate": "https://decisioninsights.ai/search/?q={search_term_string}&submit=1"
      }
    },
    "publisher": {
      "@id": "https://decisioninsights.ai/#organization"
    },
    "url": "https://decisioninsights.ai"
  },
  {
    "@context": "https://schema.org",
    "@id": "https://decisioninsights.ai/#organization",
    "@type": "Organization",
    "contactPoint": {
      "@type": "ContactPoint",
      "contactType": "customer support",
      "email": "[email protected]"
    },
    "description": "Decision Insights is a Registry of technology companies, open source projects, and industry terms, built for people and for AI agents that need sourced, structured information.",
    "logo": {
      "@type": "ImageObject",
      "url": "https://wiretap-cdn-assets.nyc3.cdn.digitaloceanspaces.com/decision-insights/[email protected]"
    },
    "name": "Decision Insights",
    "parentOrganization": {
      "@type": "Organization",
      "name": "Wiretap Labs",
      "sameAs": [
        "https://www.linkedin.com/company/wiretap-labs",
        "https://www.crunchbase.com/organization/wiretap-labs"
      ],
      "url": "https://wiretaplabs.com"
    },
    "publishingPrinciples": "https://decisioninsights.ai/standards/",
    "sameAs": [
      "https://www.linkedin.com/company/decisioninsights"
    ],
    "url": "https://decisioninsights.ai"
  },
  {
    "@context": "https://schema.org",
    "@type": "BreadcrumbList",
    "itemListElement": [
      {
        "@type": "ListItem",
        "item": "https://decisioninsights.ai",
        "name": "Decision Insights",
        "position": 1
      },
      {
        "@type": "ListItem",
        "item": "https://decisioninsights.ai/records/",
        "name": "Records",
        "position": 2
      },
      {
        "@type": "ListItem",
        "item": "https://decisioninsights.ai/mlcommons-releases-mlperf-inference-v5-1-benchmark-suite/",
        "name": "MLCommons Releases MLPerf Inference v5.1 Benchmark Suite",
        "position": 3
      }
    ]
  },
  {
    "@context": "https://schema.org",
    "@id": "https://decisioninsights.ai/mlcommons-releases-mlperf-inference-v5-1-benchmark-suite/#blogposting",
    "@type": "NewsArticle",
    "about": {
      "@id": "https://decisioninsights.ai/registry/mlcommons/#organization",
      "@type": "Organization",
      "mainEntityOfPage": "https://decisioninsights.ai/registry/mlcommons/",
      "name": "MLCommons"
    },
    "articleSection": [
      "Artificial Intelligence",
      "AI infrastructure",
      "Data Center"
    ],
    "audience": [
      {
        "@type": "Audience",
        "additionalType": "Adoption curve",
        "audienceType": "Early Adopters"
      }
    ],
    "author": {
      "@id": "https://decisioninsights.ai/author/decision-insights-signals/#person",
      "@type": "Person",
      "name": "Decision Insights Record",
      "url": "https://decisioninsights.ai/author/decision-insights-signals/"
    },
    "dateModified": "2026-08-23T14:11:44-06:00",
    "datePublished": "2025-09-09T09:05:15-06:00",
    "description": "MLCommons unveils MLPerf Inference v5.1 benchmarks, featuring three new tests and showcasing performance improvements in AI systems.",
    "headline": "MLCommons Releases MLPerf Inference v5.1 Benchmark Suite",
    "isBasedOn": {
      "@type": "CreativeWork",
      "sourceOrganization": {
        "@type": "Organization",
        "name": "GlobeNewswire"
      },
      "url": "https://www.globenewswire.com/news-release/2025/09/09/3147136/0/en/MLCommons-Releases-New-MLPerf-Inference-v5-1-Benchmark-Results.html"
    },
    "keywords": [
      "Benchmark Suite",
      "Inference"
    ],
    "mainEntityOfPage": {
      "@id": "https://decisioninsights.ai/mlcommons-releases-mlperf-inference-v5-1-benchmark-suite/",
      "@type": "WebPage",
      "sdDatePublished": "2026-08-23",
      "sdPublisher": {
        "@id": "https://decisioninsights.ai/#organization"
      }
    },
    "mentions": [
      {
        "@id": "https://decisioninsights.ai/registry/facebook/#organization",
        "@type": "Organization",
        "mainEntityOfPage": "https://decisioninsights.ai/registry/facebook/",
        "name": "Meta Platforms"
      },
      {
        "@id": "https://decisioninsights.ai/registry/mlcommons/#organization",
        "@type": "Organization",
        "mainEntityOfPage": "https://decisioninsights.ai/registry/mlcommons/",
        "name": "MLCommons"
      }
    ],
    "publisher": {
      "@id": "https://decisioninsights.ai/#organization"
    }
  },
  {
    "@context": "https://schema.org",
    "@id": "https://decisioninsights.ai/author/decision-insights-signals/#person",
    "@type": "Person",
    "description": "Press releases and independent analyst research, structured into concise summaries for research and monitoring. Produced under our Standards & Methodology.",
    "name": "Decision Insights Record",
    "sameAs": [
      "https://www.linkedin.com/showcase/decisioninsights/"
    ],
    "url": "https://decisioninsights.ai/author/decision-insights-signals/"
  }
]

Is this your company? Get structured data for your own pages