A comprehensive toolchain for workload characterization across JVM languages

Authors:
Aibek Sarimbekov;Andreas Sewe;Stephen Kell;Yudi Zheng;Walter Binder;Lubomír Bulej;Danilo Ansaloni
Affiliations:
University of Lugano, Lugano, Switzerland;Technische Universität Darmstadt, Darmstadt, Germany;University of Lugano, Lugano, Switzerland;University of Lugano, Lugano, Switzerland;University of Lugano, Lugano, Switzerland;Charles University, Prague, Czech Republic;University of Lugano, Lugano, Switzerland
Venue:
Proceedings of the 11th ACM SIGPLAN-SIGSOFT Workshop on Program Analysis for Software Tools and Engineering
Year:
2013

Citing 26
Cited 2

Thin locks: featherweight synchronization for Java

PLDI '98 Proceedings of the ACM SIGPLAN 1998 conference on Programming language design and implementation
A methodology for benchmarking Java Grande applications

JAVA '99 Proceedings of the ACM 1999 conference on Java Grande
Removing unnecessary synchronization in Java

Proceedings of the 14th ACM SIGPLAN conference on Object-oriented programming, systems, languages, and applications
Platform independent dynamic Java virtual machine analysis: the Java Grande Forum Benchmark suite

Proceedings of the 2001 joint ACM-ISCOPE conference on Java Grande
Error-free garbage collection traces: how to cheat and not get caught

SIGMETRICS '02 Proceedings of the 2002 ACM SIGMETRICS international conference on Measurement and modeling of computer systems
Java Virtual Machine Specification

Java Virtual Machine Specification
Space- and Time-Efficient Implementation of the Java Object Model

ECOOP '02 Proceedings of the 16th European Conference on Object-Oriented Programming
Characterizing Java" Application Performance

IPDPS '03 Proceedings of the 17th International Symposium on Parallel and Distributed Processing
Stack allocation and synchronization optimizations for Java using escape analysis

ACM Transactions on Programming Languages and Systems (TOPLAS)
Dynamic metrics for java

OOPSLA '03 Proceedings of the 18th annual ACM SIGPLAN conference on Object-oriented programing, systems, languages, and applications
A method-level comparison of the Java Grande and SPEC JVM98 benchmark suites: Research Articles

Concurrency and Computation: Practice & Experience - 2002 ACM Java Grande–ISCOPE Conference Part II
Immutability specification and its applications: Research Articles

Concurrency and Computation: Practice & Experience - 2002 ACM Java Grande—ISCOPE Conference Part I
Profiling with AspectJ

Software—Practice & Experience
Jolt: lightweight dynamic analysis and removal of object churn

Proceedings of the 23rd ACM SIGPLAN conference on Object-oriented programming systems languages and applications
A scalable technique for characterizing the usage of temporaries in framework-intensive Java applications

Proceedings of the 16th ACM SIGSOFT International Symposium on Foundations of software engineering
SPECjvm2008 Performance Characterization

Proceedings of the 2009 SPEC Benchmark Workshop on Computer Performance Evaluation and Benchmarking
Tracing the meta-level: PyPy's tracing JIT compiler

Proceedings of the 4th workshop on the Implementation, Compilation, Optimization of Object-Oriented Languages and Programming Systems
An analysis of the dynamic behavior of JavaScript programs

PLDI '10 Proceedings of the 2010 ACM SIGPLAN conference on Programming language design and implementation
JSMeter: comparing the behavior of JavaScript benchmarks with real web applications

WebApps'10 Proceedings of the 2010 USENIX conference on Web application development
Why nothing matters: the impact of zeroing

Proceedings of the 2011 ACM international conference on Object oriented programming systems languages and applications
Da capo con scala: design and analysis of a scala benchmark suite for the java virtual machine

Proceedings of the 2011 ACM international conference on Object oriented programming systems languages and applications
Portable and accurate collection of calling-context-sensitive bytecode metrics for the Java virtual machine

Proceedings of the 9th International Conference on Principles and Practice of Programming in Java
Elephant Tracks: generating program traces with object death records

Proceedings of the 9th International Conference on Principles and Practice of Programming in Java
Fine-grained adaptive biased locking

Proceedings of the 9th International Conference on Principles and Practice of Programming in Java
new Scala() instance of Java: a comparison of the memory behaviour of Java and Scala programs

Proceedings of the 2012 international symposium on Memory Management
k-Calling context profiling

Proceedings of the ACM international conference on Object oriented programming systems languages and applications

JVM-hosted languages: they talk the talk, but do they walk the walk?

Proceedings of the 2013 International Conference on Principles and Practices of Programming on the Java Platform: Virtual Machines, Languages, and Tools
Characteristics of dynamic JVM languages

Proceedings of the 7th ACM workshop on Virtual machines and intermediate languages

Quantified Score

Hi-index	0.00

Visualization

Abstract

The Java Virtual Machine (JVM) today hosts implementations of numerous languages. To achieve high performance, JVM implementations rely on heuristics in choosing compiler optimizations and adapting garbage collection behavior. Historically, these heuristics have been tuned to suit the dynamics of Java programs only. This leads to unnecessarily poor performance in case of non-Java languages, which often exhibit systematic differences in workload behavior. Dynamic metrics characterizing the workload help to identify and quantify useful optimizations, but so far, no cohesive suite of metrics has adequately covered properties that vary systematically between Java and non-Java workloads. We present a suite of such metrics, justifying our choice with reference to a range of guest languages. These metrics are implemented on a common portable infrastructure which ensures ease of deployment and customization.