The Quadrics Network (QsNet): High-Performance Clustering Technology
HOTI '01 Proceedings of the The Ninth Symposium on High Performance Interconnects
Xen and the art of virtualization
SOSP '03 Proceedings of the nineteenth ACM symposium on Operating systems principles
Diagnosing performance overheads in the xen virtual machine environment
Proceedings of the 1st ACM/USENIX international conference on Virtual execution environments
Direct Cache Access for High Bandwidth Network I/O
Proceedings of the 32nd annual international symposium on Computer Architecture
Performance Characterization of a 10-Gigabit Ethernet TOE
HOTI '05 Proceedings of the 13th Symposium on High Performance Interconnects
Optimizing network virtualization in Xen
ATEC '06 Proceedings of the annual conference on USENIX '06 Annual Technical Conference
High performance VMM-bypass I/O in virtual machines
ATEC '06 Proceedings of the annual conference on USENIX '06 Annual Technical Conference
An Analysis of 10-Gigabit Ethernet Protocol Stacks in Multicore Environments
HOTI '07 Proceedings of the 15th Annual IEEE Symposium on High-Performance Interconnects
Scheduling I/O in virtual machine monitors
Proceedings of the fourth ACM SIGPLAN/SIGOPS international conference on Virtual execution environments
Crossbow: from hardware virtualized NICs to virtualized networks
Proceedings of the 1st ACM workshop on Virtualized infrastructure systems and architectures
Proceedings of the 3rd International Conference on Principles, Systems and Applications of IP Telecommunications
Supporting soft real-time tasks in the xen hypervisor
Proceedings of the 6th ACM SIGPLAN/SIGOPS international conference on Virtual execution environments
I/O scheduling model of virtual machine based on multi-core dynamic partitioning
Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing
Power-aware I/O virtualization
WIOV'10 Proceedings of the 2nd conference on I/O virtualization
Fair multithreading on packet processors for scalable network virtualization
Proceedings of the 6th ACM/IEEE Symposium on Architectures for Networking and Communications Systems
Virtual WiFi: bring virtualization from wired to wireless
Proceedings of the 7th ACM SIGPLAN/SIGOPS international conference on Virtual execution environments
The effect of multi-core on HPC applications in virtualized systems
Euro-Par 2010 Proceedings of the 2010 conference on Parallel processing
Providing performance guarantees to virtual machines using real-time scheduling
Euro-Par 2010 Proceedings of the 2010 conference on Parallel processing
Packet aggregation based network I/O virtualization for cloud computing
Computer Communications
ELI: bare-metal performance for I/O virtualization
ASPLOS XVII Proceedings of the seventeenth international conference on Architectural Support for Programming Languages and Operating Systems
CompSC: live migration with pass-through devices
VEE '12 Proceedings of the 8th ACM SIGPLAN/SIGOPS conference on Virtual Execution Environments
Adaptive dynamic priority scheduling for virtual desktop infrastructures
Proceedings of the 2012 IEEE 20th International Workshop on Quality of Service
Towards exitless and efficient paravirtual I/O
Proceedings of the 5th Annual International Systems and Storage Conference
High performance network virtualization with SR-IOV
Journal of Parallel and Distributed Computing
Optimizing interactive performance for desktop-virtualization environment
ICPCA/SWS'12 Proceedings of the 2012 international conference on Pervasive Computing and the Networked World
Enabling fast, dynamic network processing with clickOS
Proceedings of the second ACM SIGCOMM workshop on Hot topics in software defined networking
Characterizing the impact of end-system affinities on the end-to-end performance of high-speed flows
NDM '13 Proceedings of the Third International Workshop on Network-Aware Data Management
Efficient and scalable paravirtual I/O system
USENIX ATC'13 Proceedings of the 2013 USENIX conference on Annual Technical Conference
The Journal of Supercomputing
DMVL: An I/O bandwidth dynamic allocation method for virtual networks
Journal of Network and Computer Applications
Hi-index | 0.00 |
Virtualization technology is now widely deployed on high performance networks such as 10-Gigabit Ethernet (10GE). It offers useful features like functional isolation, manageability and live migration. Unfortunately, the overhead of network I/O virtualization significantly degrades the performance of network-intensive applications. Two major factors of loss in I/O performance result from the extra driver domain to process I/O requests and the extra scheduler inside the virtual machine monitor (VMM) for scheduling domains. In this paper we first examine the negative effect of virtualization in multi-core platforms with 10GE networking. We study virtualization overhead and develop two optimizations for the VMM scheduler to improve I/O performance. The first solution uses cache-aware scheduling to reduce inter-domain communication cost. The second solution steals scheduler credits to favor I/O VCPUs in the driver domain. We also propose two optimizations to improve packet processing in the driver domain. First we re-design a simple bridge for more efficient switching of packets. Second we develop a patch to make transmit (TX) queue length in the driver domain configurable and adaptable to 10GE networks. Using all the above techniques, our experiments show that virtualized I/O bandwidth can be increased by 96%. Our optimizations also improve the efficiency by saving 36% in core utilization per gigabit. All the optimizations are based on pure software approaches and do not hinder live migration. We believe that the findings from our study will be useful to guide future VMM development.