Latency lags bandwith

Authors:
David A. Patterson
Affiliations:
University of California at Berkeley
Venue:
Communications of the ACM - Voting systems
Year:
2004

Citing 3
Cited 43

Computer organization and design (2nd ed.): the hardware/software interface

Computer organization and design (2nd ed.): the hardware/software interface
Computer Architecture: A Quantitative Approach

Computer Architecture: A Quantitative Approach
Technological impact of magnetic hard disk drives on storage systems

IBM Systems Journal

System Support to Balance the Resource Supply and Demand in High-end Computing

IPDPS '05 Proceedings of the 19th IEEE International Parallel and Distributed Processing Symposium (IPDPS'05) - Workshop 10 - Volume 11
Why flow-completion time is the right metric for congestion control

ACM SIGCOMM Computer Communication Review
Optimization of a tandem router network using a fluid model

Proceedings of the 9th ACM international symposium on Modeling analysis and simulation of wireless and mobile systems
Physical Database Design: the database professional's guide to exploiting indexes, views, storage, and more

Physical Database Design: the database professional's guide to exploiting indexes, views, storage, and more
Streaming architectures and technology trends

SIGGRAPH '05 ACM SIGGRAPH 2005 Courses
AppleScript

Proceedings of the third ACM SIGPLAN conference on History of programming languages
Mean-variance performance optimization of response time in a tandem router network with batch arrivals

Cluster Computing
Block cache for embedded systems

Proceedings of the 2008 Asia and South Pacific Design Automation Conference
A case for flash memory ssd in enterprise database applications

Proceedings of the 2008 ACM SIGMOD international conference on Management of data
Breaking the memory wall in MonetDB

Communications of the ACM - Surviving the data deluge
Trend and Challenge on System-on-a-Chip Designs

Journal of Signal Processing Systems
Architecture of a Database System

Foundations and Trends in Databases
Storage-class memory: the next storage system technology

IBM Journal of Research and Development
Overview of candidate device technologies for storage-class memory

IBM Journal of Research and Development
Roofline: an insightful visual performance model for multicore architectures

Communications of the ACM - A Direct Path to Dependable Software
Towards practical page coloring-based multicore cache management

Proceedings of the 4th ACM European conference on Computer systems
Improving Memory Subsystem Performance Using ViVA: Virtual Vector Architecture

ARCS '09 Proceedings of the 22nd International Conference on Architecture of Computing Systems
Advances in flash memory SSD technology for enterprise database applications

Proceedings of the 2009 ACM SIGMOD International Conference on Management of data
Remote Batch Invocation for Compositional Object Services

Genoa Proceedings of the 23rd European Conference on ECOOP 2009 --- Object-Oriented Programming
Hiding message delivery latency using Direct-to-Cache-Transfer techniques in message passing environments

Microprocessors & Microsystems
A peer-to-peer IO buffering service based on RAM-grid

International Journal of Autonomous and Adaptive Communications Systems
NCRS: a network RAM-based computational resource sharing grid

NET-COOP'07 Proceedings of the 1st EuroFGI international conference on Network control and optimization
Peer-to-peer single hop distributed hash tables

GLOBECOM'09 Proceedings of the 28th IEEE conference on Global telecommunications
Large-scale neighbor-joining with NINJA

WABI'09 Proceedings of the 9th international conference on Algorithms in bioinformatics
Performance Evaluation of a Multicore System with Optically Connected Memory Modules

NOCS '10 Proceedings of the 2010 Fourth ACM/IEEE International Symposium on Networks-on-Chip
An organic model for detecting cyber-events

Proceedings of the Sixth Annual Workshop on Cyber Security and Information Intelligence Research
Motivating future interconnects: a differential measurement analysis of PCI latency

Proceedings of the 5th ACM/IEEE Symposium on Architectures for Networking and Communications Systems
A distributed paging RAM grid system for wide-area memory sharing

IPDPS'06 Proceedings of the 20th international conference on Parallel and distributed processing
On content-centric router design and implications

Proceedings of the Re-Architecting the Internet Workshop
Moguls: a model to explore the memory hierarchy for bandwidth improvements

Proceedings of the 38th annual international symposium on Computer architecture
Balance principles for algorithm-architecture co-design

HotPar'11 Proceedings of the 3rd USENIX conference on Hot topic in parallelism
Pinned to the walls: impact of packaging and application properties on the memory and power walls

Proceedings of the 17th IEEE/ACM international symposium on Low-power electronics and design
Toward five-dimensional scaling: how density improves efficiency in future computers

IBM Journal of Research and Development
Automatic prefetching by traversal profiling in object persistence architectures

ECOOP'06 Proceedings of the 20th European conference on Object-Oriented Programming
Peak objects

ECOOP'06 Proceedings of the 20th European conference on Object-Oriented Programming
CloudRAMSort: fast and efficient large-scale distributed RAM sort on shared-nothing cluster

SIGMOD '12 Proceedings of the 2012 ACM SIGMOD International Conference on Management of Data
Towards energy-efficient database cluster design

Proceedings of the VLDB Endowment
Evaluation of I/O technologies on a flash-based I/O sub-system for HPC

Proceedings of the 1st Workshop on Architectures and Systems for Big Data
Architecting Enterprises for IT-enabled Value Creation Part 1

International Journal of Green Computing
Bobtail: avoiding long tails in the cloud

nsdi'13 Proceedings of the 10th USENIX conference on Networked Systems Design and Implementation
New wine in old skins: the case for distributed operating systems in the data center

Proceedings of the 4th Asia-Pacific Workshop on Systems
Small is better: avoiding latency traps in virtualized data centers

Proceedings of the 4th annual Symposium on Cloud Computing
Minimizing synchronizations in sparse iterative solvers for distributed supercomputers

Computers & Mathematics with Applications

Quantified Score

Hi-index	0.00

Visualization

Abstract

As I review performance trends, I am struck by a consistent theme across many technologies: bandwidth improves much more quickly than latency. Here, I list a half-dozen performance milestones to document this observation, many reasons why it happens, a few ways to cope with it, a rule of thumb to quantify it, plus an example of how to design systems differently based on this observation.