Change search
ReferencesLink to record
Permanent link

Direct link
Handling Data Flows of Streaming Internet of Things Data
Uppsala University, Disciplinary Domain of Science and Technology, Mathematics and Computer Science, Department of Information Technology.
2016 (English)Independent thesis Advanced level (degree of Master (Two Years)), 20 credits / 30 HE creditsStudent thesis
Abstract [en]

Streaming data in various formats is generated in a very fast way and these data needs to be processed and analyzed before it becomes useless. The technology currently existing provides the tools to process these data and gain more meaningful information out of it. This thesis has two parts: theoretical and practical. The theoretical part investigates what tools are there that are suitable for stream data flow processing and analysis. In doing so, it starts with studying one of the main streaming data source that produce large volumes of data: Internet of Things. In this, the technologies behind it, common use cases, challenges, and solutions are studied. Then it is followed by overview of selected tools namely Apache NiFi, Apache Spark Streaming and Apache Storm studying their key features, main components, and architecture. After the tools are studied, 5 parameters are selected to review how each tool handles these parameters. This can be useful for considering choosing certain tool given the parameters and the use case at hand. The second part of the thesis involves Twitter data analysis which is done using Apache NiFi, one of the tools studied. The purpose is to show how NiFi can be used for processing data starting from ingestion to finally sending it to storage systems. It is also to show how it communicates with external storage, search, and indexing systems.

Place, publisher, year, edition, pages
2016. , 70 p.
Series
IT
National Category
Engineering and Technology
Identifiers
URN: urn:nbn:se:uu:diva-302102OAI: oai:DiVA.org:uu-302102DiVA: diva2:956406
Educational program
Master Programme in Computer Science
Supervisors
Examiners
Available from: 2016-08-30 Created: 2016-08-30 Last updated: 2016-08-30Bibliographically approved

Open Access in DiVA

fulltext(2382 kB)43 downloads
File information
File name FULLTEXT01.pdfFile size 2382 kBChecksum SHA-512
6531de462795ef49afd71beb4f0fb775707761627b53b034ef3ae36db4156b903861ce559fb75550bc833bdd23dec4d519d238f4156bcf7ab61d2d6052880643
Type fulltextMimetype application/pdf

By organisation
Department of Information Technology
Engineering and Technology

Search outside of DiVA

GoogleGoogle Scholar
Total: 43 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Total: 129 hits
ReferencesLink to record
Permanent link

Direct link