An Uncertainty-Aware Approach to Optimal Configuration of Stream Processing Systems
Author(s)
Jamshidi, P
Casale, G
Type
Dataset
Abstract
The archive contains 10 comma separated datasets representing performance measurements (throughput and latency) for 3 different stream benchmark applications. These have been experimentally collected on 5 different cloud cluster over the course of 3 months (24/7). Each row in the datasets represents a different configuration setting for the application and the last two columns represent the average performance of the application measured over the course of 10 minutes under that specific configuration setting. The datasets contains a full factorial and exhaustive measurements for all possible settings limited to a predetermined interval for each variable. Each dataset is named in the following format: "benchmark_application-dimensions-cluster_name". For example, "wc-6d-c1" refers to WordCount benchmark application with 6 dimensions (i.e., we varied 6 configuration parameters) and the application was deployed on c1 cluster (OpenNebula, see Appendix). This resulted in a dataset of size 2880, i.e., it has taken 2880*10m=480h=20days for collecting the data
Date Issued
2016-06-22
Citation
2016
Sponsor
Commission of the European Communities
Grant Number
644869
Subjects
Stream Processing System
DevOps
Big Data
Data Access
https://zenodo.org/record/56238