Predicting response times for the Spotify backend
2012 (English)In: Proceedings of the 2012 8th International Conference on Network and Service Management, CNSM 2012, IFIP , 2012, 117-125 p.Conference paper (Refereed)
We model and evaluate the performance of a distributed key-value storage system that is part of the Spotify backend. Spotify is an on-demand music streaming service, offering low-latency access to a library of over 16 million tracks and serving over 10 million users currently. We first present a simplified model of the Spotify storage architecture, in order to make its analysis feasible. We then introduce an analytical model for the distribution of the response time, a key metric in the Spotify service. We parameterize and validate the model using measurements from two different testbed configurations and from the operational Spotify infrastructure. We find that the model is accurate - measurements are within 11% of predictions - within the range of normal load patterns. We apply the model to what-if scenarios that are essential to capacity planning and robustness engineering. The main difference between our work and related research in storage system performance is that our model provides distributions of key system metrics, while related research generally gives only expectations, which is not sufficient in our case.
Place, publisher, year, edition, pages
IFIP , 2012. 117-125 p.
distributed object store, Key-value store, performance measurements, performance modeling, response times, streaming media services, system dimensioning
IdentifiersURN: urn:nbn:se:kth:diva-112841ScopusID: 2-s2.0-84872061963ISBN: 978-390188249-4OAI: oai:DiVA.org:kth-112841DiVA: diva2:587561
2012 8th International Conference on Network and Service Management, CNSM 2012; Las Vegas, NV; 22 October 2012 through 26 October 2012
QC 201301292013-01-142013-01-142015-05-28Bibliographically approved