Skip to main content

Term · Topic

Latency

Latency is the measured time delay between a request and its response in a digital system, usually in milliseconds, and matters in enterprise environments because it constrains performance, reliability targets, and user experience for networks, applications, storage, and distributed workloads.

  • 80 articles
  • 137 companies
  • Most covered: Aviz Networks, Nvidia, Sonic

What is Latency?

Latency is the elapsed time between a request or stimulus and the corresponding response in a digital system, typically measured in milliseconds, used to characterize performance in networks, applications, storage, and computing.

Latency quantifies delay across a path that can include processors, memory, storage, and networks. It often appears as one-way latency, round-trip time, or end-to-end delay, and organizations usually measure it in milliseconds or microseconds.

In networks, latency includes propagation, transmission, processing, and queuing delays. In compute and storage, latency covers the time required for instruction execution, memory access, input or output operations, and data retrieval or commit operations.

Enterprise Usage and Architectural Context

Enterprises track latency as a core performance metric for networked applications, cloud services, databases, APIs, and microservices. Service level objectives and Service Level Agreements (SLAs) often specify latency thresholds for end-user transactions and machine-to-machine interactions.

Architects manage latency through network design, Traffic Engineering (TE), workload placement, data locality, and caching strategies. Observability platforms, synthetic testing, and protocol-level instrumentation expose latency distributions such as p50, p95, and p99 to support capacity planning and incident response.

Related or Adjacent Technologies

Latency closely relates to throughput, jitter, and packet loss in network engineering. It also relates to storage input/output operations per second (IOPS), query response time in databases, and tail latency behavior in distributed systems.

Standards bodies and industry groups define latency metrics and test methods for domains such as 5G, Time-Sensitive Networking (TSN), and real-time industrial control. Performance engineering practices incorporate latency into benchmarking, load testing, and Quality of Service (QoS) mechanisms.

Business and Operational Significance

Latency affects user experience, transaction completion rates, and the behavior of real-time applications such as voice, video, trading, and industrial automation. High or variable latency can contribute to timeouts, retries, and Service Level Objective (SLO) breaches.

Operations teams use latency metrics for incident detection, Root Cause Analysis (RCA), and change validation. Procurement, network planning, and cloud migration decisions often evaluate latency characteristics of connectivity options, data center locations, and service providers.

Our definition.

Companies in this area

Listed by how often coverage ties them to this term.

Recent coverage

Blog post · Oct 2026 · Source: delloro.com Dell'Oro Group finds optics central to AI networking at OCP 2026 Dell'Oro highlights six OCP 2026 developments, including co-packaged optics, 1.6T switching and Ethernet scale-up. Press release · Oct 2026 · Source: globenewswire.com NVIDIA and Cisco outline USFP optical module for AI factories NVIDIA and Cisco outlined plans for Ultra-Dense Small Form Factor Pluggable (USFP), a 400Gb/s-per-lane optical module. Blog post · Aug 2026 · Source: aviznetworks.com Network Copilot details background agents in 1.7.0 Network Copilot 1.7.0 adds Background Agents for CRON-based and one-time AI jobs.