Flash memory performance on a highly scalable IOV system

Authors:
Peter Kirkpatrick;Adel Alsaadi;Purnachandar Mididuddi;Prakash Chauhan;Afshin Daghi;Daniel Kim;Sang Kim;K. R. Kishor;Paritosh Kulkarni;Michael Lyons;Kiran Malwankar;Hemanth Ravi;Swaminathan Saikumar;Mani Subramanian;Marimuthu Thangaraj;Arvind Vasudev;Vinay Venkataraghavan;Carl Yang;Wilson Yang
Affiliations:
Aprius, Inc.;Aprius, Inc.;Aprius, Inc.;Aprius, Inc.;Aprius, Inc.;Aprius, Inc.;Aprius, Inc.;Aprius, Inc.;Aprius, Inc.;Aprius, Inc.;Aprius, Inc.;Aprius, Inc.;Aprius, Inc.;Aprius, Inc.;Aprius, Inc.;Aprius, Inc.;Aprius, Inc.;Aprius, Inc.;Aprius, Inc.
Venue:
WIOV'11 Proceedings of the 3rd conference on I/O virtualization
Year:
2011

Citing 17
Cited 0

Disco: running commodity operating systems on scalable multiprocessors

ACM Transactions on Computer Systems (TOCS)
Virtualizing I/O Devices on VMware Workstation's Hosted Virtual Machine Monitor

Proceedings of the General Track: 2002 USENIX Annual Technical Conference
Xen and the art of virtualization

SOSP '03 Proceedings of the nineteenth ACM symposium on Operating systems principles
ExpressEther - Ethernet-Based Virtualization Technology for Reconfigurable Hardware Platform

HOTI '06 Proceedings of the 14th IEEE Symposium on High-Performance Interconnects
Fast transparent migration for virtual machines

ATEC '05 Proceedings of the annual conference on USENIX Annual Technical Conference
Live migration of virtual machines

NSDI'05 Proceedings of the 2nd conference on Symposium on Networked Systems Design & Implementation - Volume 2
Protection strategies for direct access to virtualized I/O devices

ATC'08 USENIX 2008 Annual Technical Conference on Annual Technical Conference
Bridging the gap between software and hardware techniques for I/O virtualization

ATC'08 USENIX 2008 Annual Technical Conference on Annual Technical Conference
Flash Storage Today

Queue - Enterprise Flash Storage
High-Speed, Short-Latency Multipath Ethernet Transport for Interconnections

HOTI '08 Proceedings of the 2008 16th IEEE Symposium on High Performance Interconnects
Energy proportional datacenter networks

Proceedings of the 37th annual international symposium on Computer architecture
DFS: a file system for virtualized flash storage

FAST'10 Proceedings of the 8th USENIX conference on File and storage technologies
Scalable I/O - a well-architected way to do scalable, secure and virtualized I/O

WIOV'08 Proceedings of the First conference on I/O virtualization
Standardized but flexible I/O for self-virtualizing devices

WIOV'08 Proceedings of the First conference on I/O virtualization
I/O virtualization bottlenecks in cloud computing today

WIOV'10 Proceedings of the 2nd conference on I/O virtualization
Multi-root Share of Single-Root I/O Virtualization (SR-IOV) Compliant PCI Express Device

HOTI '10 Proceedings of the 2010 18th IEEE Symposium on High Performance Interconnects
Tech Titans Building Boom

IEEE Spectrum

Quantified Score

Hi-index	0.00

Visualization

Abstract

We present an enterprise-class I/O virtualization (IOV) system, discuss the architecture, and share performance characterization results using extremely high performance flash memory as a load generator. This work describes an IOV system built on the PCI-Express over Ethernet (PCIeOE) protocol, which combines these two ubiquitous, standardized technologies in a novel fashion. By preserving the PCI-Express (PCIe) device and software model, computers interface to the system without modifications to hardware or software. By utilizing 10G Ethernet as a transport, the system integrates with enterprise environments, achieves very high scalability and benefits from the favorable economics of the Ethernet ecosystem. Further, we present a thorough characterization of the latency and performance of the system using very high performance flash memory as an endpoint device. Flash memory serves as a high-intensity traffic generator, and also represents a compelling application of the PCIeOE technology.