Change search
ReferencesLink to record
Permanent link

Direct link
Managing Index Repartitioning
Norwegian University of Science and Technology, Faculty of Information Technology, Mathematics and Electrical Engineering, Department of Computer and Information Science.
2011 (English)MasteroppgaveStudent thesis
Abstract [en]
Careful architectural decisions are required in order to create a highly available and scalable search system. This requires an in-depth analysis and understanding of the architecture and context of each deployment. Different requirements placed upon the system by different deployments mean different solutions provide the best case by case result, thus benchmarks provide an invaluable source of information. This thesis provides an overview of common components and important aspects of a distributed search system. It then gives an overview of different partitioning techniques before going into the details of repartitioning and rebalancing in a document-partitioned full-text search system. A processing framework that draws inspiration from flow-based programming literature is introduced, which is shown a valuable tool in creating custom tailored search solutions. The implementation is used to benchmark different repartitioning and rebalancing strategies. In conclusion, the techniques mentioned in the thesis show great promise in creating custom, maintainable and flexible partitions. The processing framework enables each specific deployment to easily compare different partitioning schemes and associated manageability and maintenance costs to determine the best fit for any given situation.
Place, publisher, year, edition, pages
Institutt for datateknikk og informasjonsvitenskap , 2011. , 100 p.
Keyword [no]
ntnudaim:5864, MTDT datateknikk, Data- og informasjonsforvaltning
URN: urn:nbn:no:ntnu:diva-13491Local ID: ntnudaim:5864OAI: diva2:439581
Available from: 2011-09-08 Created: 2011-09-08

Open Access in DiVA

fulltext(3500 kB)477 downloads
File information
File name FULLTEXT01.pdfFile size 3500 kBChecksum SHA-512
Type fulltextMimetype application/pdf
cover(45 kB)11 downloads
File information
File name COVER01.pdfFile size 45 kBChecksum SHA-512
Type coverMimetype application/pdf

By organisation
Department of Computer and Information Science

Search outside of DiVA

GoogleGoogle Scholar
Total: 477 downloads
The number of downloads is the sum of all downloads of full texts. It may include eg previous versions that are now no longer available

Total: 48 hits
ReferencesLink to record
Permanent link

Direct link