Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Building a high throughput microscope simulator using the Apache Kafka streaming framework
Uppsala University, Disciplinary Domain of Science and Technology, Mathematics and Computer Science, Department of Information Technology, Division of Scientific Computing.
2018 (English)Independent thesis Advanced level (professional degree), 20 credits / 30 HE creditsStudent thesis
Abstract [en]

Today microscopy imaging is a widely used and powerful method for investigating biological processes. The microscopes can produce large amounts of data in a short time. It is therefore impossible to analyse all the data thoroughly because of time and cost constraints. HASTE (Hierarchical Analysis of Temporal and Spatial Image Data) is a collaborative research project between Uppsala University, AstraZeneca and Vironova which addresses this specific problem. The idea is to analyse the image data in real time to make fast decisions on whether to analyse further, store or throw away the data. To facilitate the development process of this system a microscope simulator has been designed and implemented with large focus on parameters relating to data throughput. Apart from building the simulator the framework Apache Kafka has been evaluated for streaming large images. The results from this project are both a working simulator which shows a performance similar to that of the microscope and an evaluation of Apache Kafka showing that it is possible to stream image data with the framework.

Place, publisher, year, edition, pages
2018. , p. 28
Series
UPTEC F, ISSN 1401-5757 ; 18002
Keywords [en]
Data streaming, Cloud computing, Apache Kafka
National Category
Engineering and Technology
Identifiers
URN: urn:nbn:se:uu:diva-340014OAI: oai:DiVA.org:uu-340014DiVA, id: diva2:1177508
Educational program
Master Programme in Engineering Physics
Supervisors
Examiners
Available from: 2018-01-26 Created: 2018-01-25 Last updated: 2018-01-26Bibliographically approved

Open Access in DiVA

fulltext(2613 kB)94 downloads
File information
File name FULLTEXT01.pdfFile size 2613 kBChecksum SHA-512
d60777e2c5ea2bc52c046a6c1a8efcbeb3d9203b4c65bffe071c983d0d2473c725e07515ddb1a91c2115e34e4d58bccfe815e2488074fefe456035356acf99cf
Type fulltextMimetype application/pdf

By organisation
Division of Scientific Computing
Engineering and Technology

Search outside of DiVA

GoogleGoogle Scholar
Total: 94 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

urn-nbn

Altmetric score

urn-nbn
Total: 572 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf