Change search
ReferencesLink to record
Permanent link

Direct link
Scaling out parallel data stream access to a relational database
Uppsala University, Disciplinary Domain of Science and Technology, Mathematics and Computer Science, Department of Information Technology.
2014 (English)Independent thesis Advanced level (degree of Master (Two Years)), 30 credits / 45 HE creditsStudent thesis
Abstract [en]

The rise of new applications requiring processing high volumes of continuous and real time data has created the demand for data stream management systems (DSMSs). ApplicationsĀ  using DSMSs often need to access historical data saved on disk to analyze, mine, and process streaming data. The historical data is persistent and often is very voluminous and is thereforeĀ  usually stored in a relational database. If this relational database is continuously accessed from the DSMS it will become a bottleneck of the system. The linear road benchmark (LRB) is a simulated data stream benchmark, which includes access to historical data stored on disk. If the query load per unit of time becomes too large the relational database access will become a bottleneck for the DSMS processing. In this thesis we scale out a relational DBMS storing the historical LRB data in order to eliminate this bottleneck. Experiments were done on LRB with access to a scaled out MySQL databases running on a single NUMA machine with 64 cores. Scaling out the relational database access is shown to make it possible to run LRB with L rating of 512 and beyond for only daily expenditure queries and L rating of 150 for all the LRB implemented in the DSMS SCSQ.

Place, publisher, year, edition, pages
IT, 14 024
National Category
Engineering and Technology
URN: urn:nbn:se:uu:diva-232180OAI: diva2:746809
Educational program
Master Programme in Computer Science
Available from: 2014-09-15 Created: 2014-09-15 Last updated: 2014-09-15Bibliographically approved

Open Access in DiVA

fulltext(1338 kB)140 downloads
File information
File name FULLTEXT01.pdfFile size 1338 kBChecksum SHA-512
Type fulltextMimetype application/pdf

By organisation
Department of Information Technology
Engineering and Technology

Search outside of DiVA

GoogleGoogle Scholar
Total: 140 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Total: 808 hits
ReferencesLink to record
Permanent link

Direct link