Digitala Vetenskapliga Arkivet

Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Intelligent Resource Management for Large-scale Data Stream Processing
Uppsala University, Disciplinary Domain of Science and Technology, Mathematics and Computer Science, Department of Information Technology.
2019 (English)Independent thesis Advanced level (professional degree), 20 credits / 30 HE creditsStudent thesis
Abstract [en]

With the increasing trend of using cloud computing resources, the efficient utilization of these resources becomes more and more important. Working with data stream processing is a paradigm gaining in popularity, with tools such as Apache Spark Streaming or Kafka widely available, and companies are shifting towards real-time monitoring of data such as sensor networks, financial data or anomaly detection. However, it is difficult for users to efficiently make use of cloud computing resources and studies show that a lot of energy and compute hardware is wasted. We propose an approach to optimizing resource usage in cloud computing environments designed for data stream processing frameworks, based on bin packing algorithms. Test results show that the resource usage is substantially improved as a result, with future improvements suggested to further increase this. The solution was implemented as an extension of the HarmonicIO data stream processing framework and evaluated through simulated workloads.

Place, publisher, year, edition, pages
2019. , p. 55
Series
UPTEC IT, ISSN 1401-5749 ; 19007
National Category
Engineering and Technology
Identifiers
URN: urn:nbn:se:uu:diva-391927OAI: oai:DiVA.org:uu-391927DiVA, id: diva2:1345975
Educational program
Master of Science Programme in Information Technology Engineering
Supervisors
Examiners
Available from: 2019-08-26 Created: 2019-08-26 Last updated: 2019-08-26Bibliographically approved

Open Access in DiVA

fulltext(8915 kB)416 downloads
File information
File name FULLTEXT01.pdfFile size 8915 kBChecksum SHA-512
319fe0831bcaeef51a7879f023ba1db6a4ff47c6b466fd18cdb6ae1913a7d6246be3bf079eac2c8e431122ab2a1e7d18fa4d7a7f03a63e0ed26288eedd6f045a
Type fulltextMimetype application/pdf

By organisation
Department of Information Technology
Engineering and Technology

Search outside of DiVA

GoogleGoogle Scholar
Total: 419 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

urn-nbn

Altmetric score

urn-nbn
Total: 651 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf