Change search
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf
Influence of File Systems on Performance When Working with an Abundance of Small Files
Umeå University, Faculty of Science and Technology, Department of Computing Science.
2017 (English)Independent thesis Basic level (degree of Bachelor), 10 credits / 15 HE creditsStudent thesis
Abstract [en]

High-performance computing is widely used within the scientific community to perform demanding computational work. Using the resources available at a high-performance center in an efficient manner is of great importance. One potential bottleneck for high-performance computing is file systems.

In this study two different file systems, the Lustre file system and MATLAB Datastore, have been evaluated in terms of performance when performing computations on an abundance of small files. The performance test consisted of classification of large numbers of small (<2 megabytes) images in MATLAB using the high-performance computer system Kebnekaise at HPC2N in Umeå.

Results indicate that MATLAB Datastore gives better performance than the Lustre file system for all images sets tested in the study. This makes it possible to recommend using MATLAB Datastore over the Lustre file system in situations where large number of smaller files are to be read and from the file system.

Place, publisher, year, edition, pages
2017. , p. 22
Series
UMNAD ; 1120
National Category
Engineering and Technology
Identifiers
URN: urn:nbn:se:umu:diva-142504OAI: oai:DiVA.org:umu-142504DiVA, id: diva2:1161756
Educational program
Bachelor of Science Programme in Computing Science
Supervisors
Examiners
Available from: 2017-12-01 Created: 2017-12-01 Last updated: 2017-12-01Bibliographically approved

Open Access in DiVA

fulltext(495 kB)47 downloads
File information
File name FULLTEXT01.pdfFile size 495 kBChecksum SHA-512
10135461932b7b2a8d7f27e063e977268ecb0c43a613d4bc13f5922d4f53da9a0c95c5016b6814473562b908b946d0226711184438d957aeae5ebf4d4e39caad
Type fulltextMimetype application/pdf

By organisation
Department of Computing Science
Engineering and Technology

Search outside of DiVA

GoogleGoogle Scholar
Total: 47 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

urn-nbn

Altmetric score

urn-nbn
Total: 223 hits
CiteExportLink to record
Permanent link

Direct link
Cite
Citation style
  • apa
  • ieee
  • modern-language-association-8th-edition
  • vancouver
  • Other style
More styles
Language
  • de-DE
  • en-GB
  • en-US
  • fi-FI
  • nn-NO
  • nn-NB
  • sv-SE
  • Other locale
More languages
Output format
  • html
  • text
  • asciidoc
  • rtf