Skip to main content

MangoBoost Achieves Records in MLPerf Inference v5.0 with AMD MI300X GPUs

Source Decision Insights Coverage Published April 2, 2025 Companies 3
Human View Machine View

3 companies named across 9 categories, one of 12 articles referencing AMD. Previous coverage: Ayar Labs launches UCIe optical chiplet achieving 8 Tbps bandwidth for AI infrastructures (Apr 2025).

Companies mentioned

MangoBoost, a provider of system solutions for Artificial Intelligence (AI) efficiency, has achieved record results in MLPerf Inference v5.0 with its Mango LLMBoost™ software on AMD MI300X GPUs. This achievement marks the first-ever multi-node MLPerf inference result on these GPUs, demonstrating a significant performance advantage over prior results, including those using NVIDIA H100 GPUs.

By utilizing 32 MI300X GPUs across four server nodes, Mango LLMBoost™ secured the highest inference performance yet, achieving 103,182 tokens per second (TPS) in offline testing and 93,039 TPS in server scenarios, surpassing the previous best of 82,749 TPS on NVIDIA hardware. The software also offers substantial cost advantages, with MI300X GPUs being more affordable than their NVIDIA counterparts, resulting in potential cost savings of up to 62%.

Mango LLMBoost™ not only offers high performance but also supports over 50 open models and is designed for seamless scalability. The software is compatible with cloud environments and can be deployed on-premises (on-prem), making it suitable for various enterprise needs. Key features include efficient model distribution and runtime optimization.

This milestone was achieved through a collaboration with AMD, leveraging the ROCm software stack, which enhances the scalability and efficiency of the AI inference solution. Beyond the MLPerf results, Mango LLMBoost™ has shown superior cost-efficiency and performance across cloud configurations, further establishing its role in the AI infrastructure sector.

Mentions

Structured data (JSON-LD)

The schema.org markup this page publishes for search engines and AI agents, exactly as they read it.

[
  {
    "@context": "https://schema.org",
    "@id": "https://decisioninsights.ai/#website",
    "@type": "WebSite",
    "name": "Decision Insights",
    "potentialAction": {
      "@type": "SearchAction",
      "target": {
        "@type": "EntryPoint",
        "urlTemplate": "https://decisioninsights.ai/search/?q={search_term_string}&submit=1"
      }
    },
    "publisher": {
      "@id": "https://decisioninsights.ai/#organization"
    },
    "url": "https://decisioninsights.ai"
  },
  {
    "@context": "https://schema.org",
    "@id": "https://decisioninsights.ai/#organization",
    "@type": "Organization",
    "contactPoint": {
      "@type": "ContactPoint",
      "contactType": "customer support",
      "email": "[email protected]"
    },
    "description": "Decision Insights is a Registry of technology companies, open source projects, and industry terms, built for people and for AI agents that need sourced, structured information.",
    "logo": {
      "@type": "ImageObject",
      "url": "https://wiretap-cdn-assets.nyc3.cdn.digitaloceanspaces.com/decision-insights/[email protected]"
    },
    "name": "Decision Insights",
    "parentOrganization": {
      "@type": "Organization",
      "name": "Wiretap Labs",
      "sameAs": [
        "https://www.linkedin.com/company/wiretap-labs",
        "https://www.crunchbase.com/organization/wiretap-labs"
      ],
      "url": "https://wiretaplabs.com"
    },
    "publishingPrinciples": "https://decisioninsights.ai/standards/",
    "sameAs": [
      "https://www.linkedin.com/company/decisioninsights"
    ],
    "url": "https://decisioninsights.ai"
  },
  {
    "@context": "https://schema.org",
    "@type": "BreadcrumbList",
    "itemListElement": [
      {
        "@type": "ListItem",
        "item": "https://decisioninsights.ai",
        "name": "Decision Insights",
        "position": 1
      },
      {
        "@type": "ListItem",
        "item": "https://decisioninsights.ai/records/",
        "name": "Records",
        "position": 2
      },
      {
        "@type": "ListItem",
        "item": "https://decisioninsights.ai/mangoboost-achieves-records-in-mlperf-inference-v5-0-with-amd-mi300x-gpus/",
        "name": "MangoBoost Achieves Records in MLPerf Inference v5.0 with AMD MI300X GPUs",
        "position": 3
      }
    ]
  },
  {
    "@context": "https://schema.org",
    "@id": "https://decisioninsights.ai/mangoboost-achieves-records-in-mlperf-inference-v5-0-with-amd-mi300x-gpus/#blogposting",
    "@type": "BlogPosting",
    "about": {
      "@id": "https://decisioninsights.ai/registry/amd/#organization",
      "@type": "Organization",
      "mainEntityOfPage": "https://decisioninsights.ai/registry/amd/",
      "name": "AMD"
    },
    "articleSection": [
      "Artificial Intelligence",
      "AI infrastructure",
      "Data Center"
    ],
    "author": {
      "@id": "https://decisioninsights.ai/author/decision-insights-coverage/#person",
      "@type": "Person",
      "name": "Decision Insights Coverage",
      "url": "https://decisioninsights.ai/author/decision-insights-coverage/"
    },
    "dateModified": "2026-08-23T13:44:33-06:00",
    "datePublished": "2025-04-02T10:10:36-06:00",
    "description": "MangoBoost achieves record MLPerf Inference v5.0 results with Mango LLMBoost™ on AMD MI300X GPUs, offering superior performance and cost savings.",
    "headline": "MangoBoost Achieves Records in MLPerf Inference v5.0 with AMD MI300X GPUs",
    "keywords": [
      "Cloud",
      "Inference",
      "on-premises",
      "Scalability",
      "Server",
      "Software"
    ],
    "mainEntityOfPage": {
      "@id": "https://decisioninsights.ai/mangoboost-achieves-records-in-mlperf-inference-v5-0-with-amd-mi300x-gpus/",
      "@type": "WebPage",
      "sdDatePublished": "2026-08-23",
      "sdPublisher": {
        "@id": "https://decisioninsights.ai/#organization"
      }
    },
    "mentions": [
      {
        "@id": "https://decisioninsights.ai/registry/amd/#organization",
        "@type": "Organization",
        "mainEntityOfPage": "https://decisioninsights.ai/registry/amd/",
        "name": "AMD"
      },
      {
        "@id": "https://decisioninsights.ai/registry/mangoboost/#organization",
        "@type": "Organization",
        "mainEntityOfPage": "https://decisioninsights.ai/registry/mangoboost/",
        "name": "MangoBoost"
      },
      {
        "@id": "https://decisioninsights.ai/registry/nvidia-corp/#organization",
        "@type": "Organization",
        "mainEntityOfPage": "https://decisioninsights.ai/registry/nvidia-corp/",
        "name": "Nvidia"
      }
    ],
    "publisher": {
      "@id": "https://decisioninsights.ai/#organization"
    }
  },
  {
    "@context": "https://schema.org",
    "@id": "https://decisioninsights.ai/author/decision-insights-coverage/#person",
    "@type": "Person",
    "description": "Blog posts, podcasts, and video analysis from across the industry, condensed into short, sourced summaries. Produced under our Standards & Methodology.",
    "name": "Decision Insights Coverage",
    "sameAs": [
      "https://www.linkedin.com/showcase/decisioninsights/"
    ],
    "url": "https://decisioninsights.ai/author/decision-insights-coverage/"
  }
]

Is this your company? Get structured data for your own pages