Change search
ReferencesLink to record
Permanent link

Direct link
Topology-Aware Placement of Stream Processing Components on Geographically Distributed Virtualized Environments
KTH, School of Information and Communication Technology (ICT).
2015 (English)Independent thesis Advanced level (degree of Master (Two Years)), 20 credits / 30 HE creditsStudent thesis
Abstract [en]

Distributed Stream Processing Systems are typically deployed within a single datacenter in order to achieve high performance and low-latency computation. The datastreams analyzed by such systems are expected to be available in the same datacenter. Either the data streams are generated within the data center (e.g., logs,transactions, user clicks) or they are aggregated by external systems from varioussources and buffered into the data center for processing (e.g., IoT, sensor data, trafficinformation).The data center approach for stream processing analytics fits the requirements ofthe majority of the applications that exists today. However, for latency sensitiveapplications, such as real-time decisionmaking, which relies on analyzing geographically distributed data streams, a data center approach might not be sufficient. Aggregating data streams incurs high overheads in terms of latency and bandwidthconsumption in addition to the overhead of sending the analysis outcomes back towhere an action needs to be taken.In this thesis, we propose a new stream processing architecture for efficiently analyzing geographically distributed data streams. Our approach utilizes emergingdistributed virtualized environments, such as Mobile Edge Computing, to extendstream processing systems outside the data center in order to push critical parts ofthe analysis closer to the data sources. This will enable real-time applications to respond faster to geographically distributed events. We create the implementation as aplug-in extension for Apache Storm stream processing framework. 

Place, publisher, year, edition, pages
TRITA-ICT-EX, 2015:238
URN: urn:nbn:se:kth:diva-183378OAI: diva2:910273
Available from: 2016-03-08 Created: 2016-03-08 Last updated: 2016-03-08Bibliographically approved

Open Access in DiVA

fulltext(2700 kB)92 downloads
File information
File name FULLTEXT01.pdfFile size 2700 kBChecksum SHA-512
Type fulltextMimetype application/pdf

By organisation
School of Information and Communication Technology (ICT)

Search outside of DiVA

GoogleGoogle Scholar
Total: 92 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Total: 229 hits
ReferencesLink to record
Permanent link

Direct link