Managing response time tails by sharding
File(s)ShardingFV.pdf (1.64 MB)
Accepted version
Author(s)
Harrison, PG
Patel, Naresh
Perez, Juan
Qiu, Zhan
Type
Journal Article
Abstract
Matrix analytic methods are developed to compute the probability distribution of response times (i.e. data access times) in distributed
storage systems protected by erasure coding, which is implemented by sharding a data object into N fragments, only K < N of which are required to reconstruct the object. This leads to a partial-fork-join model with a choice of canceling policies for the redundant N − K tasks. The accuracy of the analytical model is supported by tests against simulation in a broad range of setups. At increasing workload intensities, numerical results show the extent to which increasing the redundancy level reduces the mean response time of storage reads and significantly flattens the tail of their distribution; this is demonstrated at medium-high quantiles, up to the 99th. The quantitative reduction in response time achieved by two policies for canceling redundant tasks is also shown: for cancel-at-finish and cancel-at-start, which limits the additional load introduced whilst losing the benefit of selectivity amongst fragment service times.
storage systems protected by erasure coding, which is implemented by sharding a data object into N fragments, only K < N of which are required to reconstruct the object. This leads to a partial-fork-join model with a choice of canceling policies for the redundant N − K tasks. The accuracy of the analytical model is supported by tests against simulation in a broad range of setups. At increasing workload intensities, numerical results show the extent to which increasing the redundancy level reduces the mean response time of storage reads and significantly flattens the tail of their distribution; this is demonstrated at medium-high quantiles, up to the 99th. The quantitative reduction in response time achieved by two policies for canceling redundant tasks is also shown: for cancel-at-finish and cancel-at-start, which limits the additional load introduced whilst losing the benefit of selectivity amongst fragment service times.
Date Issued
2019-03-03
Date Acceptance
2018-12-01
Citation
ACM transactions on modeling and performance evaluation of computing systems, 2019, 4 (1), pp.1-33
ISSN
2376-3647
Publisher
Association for Computing Machinery
Start Page
1
End Page
33
Journal / Book Title
ACM transactions on modeling and performance evaluation of computing systems
Volume
4
Issue
1
Copyright Statement
© 2019 Copyright held by the owner/author(s). Publication rights licensed to ACM.
Sponsor
Engineering & Physical Science Research Council (EPSRC)
Identifier
https://dl.acm.org/doi/10.1145/3300143
Grant Number
EP/L00738X/1
Subjects
Science & Technology
Technology
Computer Science, Information Systems
Computer Science
Sharding
parallel task processing
performance
quality of service
response time
STORAGE
Publication Status
Published
Article Number
5