Change search
ReferencesLink to record
Permanent link

Direct link
Monitoring and Analysis of Disk throughput and latency in servers running Cassandra database
Blekinge Institute of Technology, Faculty of Computing, Department of Communication Systems.
2016 (English)Independent thesis Advanced level (degree of Master (Two Years)), 20 credits / 30 HE creditsStudent thesis
Abstract [en]

Context. Light weight process virtualization has been used in the past e.g., Solaris zones, jails in Free BSD and Linux’s containers (LXC). But only since 2013 is there a kernel support for user namespace and process grouping control that make the use of lightweight virtualization interesting to create virtual environments comparable to virtual machines. Telecom providers have to handle the massive growth of information due to the growing number of customers and devices.

Traditional databases are not designed to handle such massive data ballooning. NoSQL databases were developed for this purpose. Cassandra, with its high read and write throughputs, is a popular NoSQL database to handle this kind of data. Running the database using operating system virtualization or containerization would offer a significant performance gain when compared to that of virtual machines and also gives the benefits of migration, fast boot up and shut down times, lower latency and less use of physical resources of the servers.

Objectives. This thesis aims to investigate the trade-off in performance while loading a Cassandra cluster in bare-metal and containerized environments. A detailed study of the effect of loading the cluster in each individual node in terms of Latency, CPU and Disk throughput will be analyzed. Methods. We implement the physical model of the Cassandra cluster based on realistic and commonly used scenarios or database analysis for our experiment.

We generate different load cases on the cluster for bare-metal and Cassandra in docker scenarios and see the values of CPU utilization, Disk throughput and latency using standard tools like sar and iostat. Statistical analysis (Mean value analysis, higher moment analysis, and confidence intervals) are done on measurements on specific interfaces in order to increase the reliability of the results. Results.Experimental results show a quantitative analysis of measurements consisting Latency, CPU and Disk throughput while running a Cassandra cluster in Bare Metal and Container Environments.A statistical analysis summarizing the performance of Cassandra cluster is surveyed.

Results.Experimental results show a quantitative analysis of measurements consisting Latency, CPU and Disk throughput while running a Cassandra cluster in Bare Metal and Container Environments.A statistical analysis summarizing the performance of Cassandra cluster is surveyed.

Conclusions. With the detailed analysis, the resource utilization of the database was similar in both the bare-metal and container scenarios. Disk throughput is similar in the case of mixed load and containers have a slight overhead in the case of write loads for both the maximum load case and 66% of maximum load case. The latency values inside the container are slightly higher for all the cases. The mean value analysis and higher moment analysis helps us in doing a finer analysis of the results. The confidence intervals calculated show that there is a lot of variation in the disk performance which might be due to compactions happening randomly. Future work in the area can be done on compaction strategies.

Place, publisher, year, edition, pages
2016. , 54 p.
Keyword [en]
Cassandra, No-sql, Docker, Virtual machines, Virtualisation, CQL
National Category
Telecommunications
Identifiers
URN: urn:nbn:se:bth-13459OAI: oai:DiVA.org:bth-13459DiVA: diva2:1047166
External cooperation
Ericsson
Subject / course
ET2580 Master's Thesis (120 credits) in Electrical Engineering with emphasis on Telecommunication Systems
Educational program
ETATX Master of Science Programme in Electrical Engineering with emphasis on Telecommunication Systems
Presentation
2016-09-27, J3208 Claude Shannon, Blekinge Tekniska Högskola, SE-371 79, Karlskrona, 18:22 (English)
Supervisors
Examiners
Available from: 2016-11-23 Created: 2016-11-16 Last updated: 2016-11-23Bibliographically approved

Open Access in DiVA

fulltext(3181 kB)8 downloads
File information
File name FULLTEXT02.pdfFile size 3181 kBChecksum SHA-512
eff91af94c250f14b358f85172c0774d2c0b8f901d2340f80d7ac93d7cd7ab4ac4420cda2bc653373b594a6c1537cb99c899517bf7234c166ac124aa4d659217
Type fulltextMimetype application/pdf

By organisation
Department of Communication Systems
Telecommunications

Search outside of DiVA

GoogleGoogle Scholar
Total: 8 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Total: 25 hits
ReferencesLink to record
Permanent link

Direct link