Change search
ReferencesLink to record
Permanent link

Direct link
Natural Language Processing In A Distributed  Environment: A comparative performance analysis of Apache Spark and Hadoop MapReduce
Umeå University, Faculty of Science and Technology, Department of Computing Science.
2016 (English)Independent thesis Basic level (degree of Bachelor), 10 credits / 15 HE creditsStudent thesis
Abstract [en]

A big majority of the data hosted on the internet today is in natural text and therefore understanding natural language and how to effectively process and analyzing text has become a big part of data mining. Natural Language Processing has many applications in fields such as business intelligence and security purposes.The problem with natural language text processing and analyzing is the computational power needed to perform the actual processing, performance of personal computer has not kept up with amounts of data that needs to be processed so another approach with good performance scaling potential is needed.This study does a preliminary comparative performance analysis of processing natural language text in an distributed environment using two popular open-source frameworks, Hadoop MapReduce and Apache Spark.

Place, publisher, year, edition, pages
2016. , 33 p.
Series
, UMNAD, 1052
National Category
Engineering and Technology
Identifiers
URN: urn:nbn:se:umu:diva-126865OAI: oai:DiVA.org:umu-126865DiVA: diva2:1038338
External cooperation
Sogeti
Educational program
Bachelor of Science Programme in Computing Science
Supervisors
Examiners
Available from: 2016-10-18 Created: 2016-10-18 Last updated: 2016-11-30Bibliographically approved

Open Access in DiVA

fulltext(185 kB)11 downloads
File information
File name FULLTEXT01.pdfFile size 185 kBChecksum SHA-512
4c8075cf602922fde9b1bad13254103bb504c76ec306d1773c3910a658c13dcba39484c407f18ef3f09234b9fdcd1d01c2846c0a9cc48500bf45e03dfe8e4417
Type fulltextMimetype application/pdf

By organisation
Department of Computing Science
Engineering and Technology

Search outside of DiVA

GoogleGoogle Scholar
Total: 11 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Total: 359 hits
ReferencesLink to record
Permanent link

Direct link