Change search
ReferencesLink to record
Permanent link

Direct link
Predicting response times for the Spotify backend
KTH, School of Electrical Engineering (EES), Communication Networks. KTH, School of Electrical Engineering (EES), Centres, ACCESS Linnaeus Centre.ORCID iD: 0000-0002-2680-9065
KTH, School of Electrical Engineering (EES), Centres, ACCESS Linnaeus Centre. KTH, School of Electrical Engineering (EES), Communication Networks.
2012 (English)Report (Other academic)
Abstract [en]

We model and evaluate the performance of a distributed key-value storage system that is part of the Spotify backend. Spotify is an on-demand music streaming service, offering low-latency access to a library of over 16 million tracks and serving over 10 million users currently. We first present a simplified model of the Spotify storage architecture, in order to make its analysis feasible. We then introduce an analytical model for the distribution of the response time, a key metric in the Spotify service. We parameterize and validate the model using measurements from two different testbed configurations and from the operational Spotify infrastructure. We find that the model is accurate—measurements are within 11% of predictions—within the range of normal load patterns. We apply the model to what-if scenarios that are essential to capacity planning and robustness engineering. The main difference between our work and related research in storage system performance is that our model provides distributions of key system metrics, while related research generally gives only expectations, which is not sufficient in our case.

Place, publisher, year, edition, pages
Stockholm: KTH Royal Institute of Technology, 2012. , 8 p.
Trita-EE, ISSN 1653-5146 ; 2012:022
Keyword [en]
Key-value store, distributed object store, performance modeling, system dimensioning, performance measurements, response times, streaming media services
National Category
Communication Systems
URN: urn:nbn:se:kth:diva-93735OAI: diva2:523444
ICT - The Next Generation

QC 20120528

Available from: 2012-05-28 Created: 2012-04-24 Last updated: 2013-04-15Bibliographically approved

Open Access in DiVA

fulltext(1185 kB)352 downloads
File information
File name FULLTEXT01.pdfFile size 1185 kBChecksum SHA-512
Type fulltextMimetype application/pdf

Search in DiVA

By author/editor
Yanggratoke, RerngvitKreitz, GunnarGoldmann, MikaelStadler, Rolf
By organisation
Communication NetworksACCESS Linnaeus Centre
Communication Systems

Search outside of DiVA

GoogleGoogle Scholar
Total: 352 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Total: 197 hits
ReferencesLink to record
Permanent link

Direct link