86
IRUS Total
Downloads
  Altmetric

NetAgg: Middleboxes for Application-Specific Traffic Aggregation

File Description SizeFormat 
netagg-conext14-CRV.pdfAccepted version513.79 kBAdobe PDFView/Open
Title: NetAgg: Middleboxes for Application-Specific Traffic Aggregation
Authors: Pietzuch, PR
Mai, L
Rupprecht, L
Alim, A
Costa, P
Migliavacca, M
Pietzuch, P
Wolf, A
Item Type: Conference Paper
Abstract: © 2014 ACM.Data centre applications for batch processing (e.g. map/reduce frameworks) and online services (e.g. search engines) scale by distributing data and computation across many servers. They typically follow a partition/aggregation pattern: tasks are first partitioned across servers that process data locally, and then those partial results are aggregated. This data aggregation step, however, shifts the performance bottleneck to the network, which typically struggles to support many-to-few, high-bandwidth traffic between servers. Instead of performing data aggregation at edge servers, we show that it can be done more efficiently along network paths. We describe N ET AGG , a software platform that supports on-path aggregation for network-bound partition/aggregation applications. NETAGG exploits a middlebox-like design, in which dedicated servers (agg boxes) are connected by high-bandwidth links to network switches. Agg boxes execute aggregation functions provided by applications, which alleviates network hotspots because only a fraction of the incoming traffic is forwarded at each hop. NETAGG requires only minimal application changes: it uses shim layers on edge servers to redirect application traffic transparently to the agg boxes. Our experimental results show that N ET A GG improves substantially the throughput of two sample applications, the Solr distributed search engine and the Hadoop batch processing framework. Its design allows for incremental deployment in existing data centres and incurs only a modest investment cost.
Issue Date: 1-Dec-2014
URI: http://hdl.handle.net/10044/1/18496
DOI: http:dx.doi.org/10.1145/2674005.2674996
ISBN: 978-1-4503-3279-8
Publisher: ACM
Start Page: 249
End Page: 262
Journal / Book Title: CoNext '14
Copyright Statement: © 2014 ACM. This is the author's version of the work. It is posted here by permission of ACM for your personal use. Not for redistribution. The definitive version was published in CoNEXT '14, Proceedings of the 10th ACM International on Conference on Emerging Networking Experiments and Technologies (2014) http://doi.acm.org/10.1145/2674005.2674996
Conference Name: 10th International Conference on Emerging Networking Experiments and Technologies (CoNEXT)
Conference Place: Sydney, Australia
Appears in Collections:Computing