On the performance of the Spotify backend
2013 (English)In: Journal of Network and Systems Management, ISSN 1064-7570, E-ISSN 1573-7705Article in journal (Refereed) Published
We model and evaluate the performance of a distributed key-value storage system that is part of the Spotify backend. Spotify is an on-demand music streaming service, offering low-latency access to a library of over 20 million tracks and serving over 20 million users currently. We first present a simplified model of the Spotify storage architecture, in order to make its analysis feasible. We then introduce an analytical model for the distribution of the response time, a key metric in the Spotify service. We parameterize and validate the model using measurements from two different testbed configurations and from the operational Spotify infrastructure. We find that the model is accurate---measurements are within 11% of predictions---within the range of normal load patterns.In addition, we model the capacity of the Spotify storage system under different object allocation policies and find that measurements on our testbed are within 9% of the model predictions. The model helps us justify the object allocation policy adopted for Spotify storage system.
Place, publisher, year, edition, pages
Springer-Verlag New York, 2013.
Key-value store, distributed object store, object allocation policy, performance modeling, performance measurements, response times
Communication Systems Computer Systems
IdentifiersURN: urn:nbn:se:kth:diva-129973DOI: 10.1007/s10922-013-9292-2ISI: 000350554700009ScopusID: 2-s2.0-84921067530OAI: oai:DiVA.org:kth-129973DiVA: diva2:653969