Regrouping metric-space search index for search engine size adaptation

Al Ruqeishi, Khalil and Konečný, Michal Regrouping metric-space search index for search engine size adaptation. IN: Similarity search and applications. Amato, Giuseppe; Connor, Richard; Falchi, Fabrizio and Gennaro, Claudio (eds) Lecture notes in computer science . Chem (CH): Springer.

Abstract

This work contributes to the development of search engines that self-adapt their size in response to fluctuations in workload. Deploying a search engine in an Infrastructure as a Service (IaaS) cloud facilitates allocating or deallocating computational resources to or from the engine. In this paper, we focus on the problem of regrouping the metric-space search index when the number of virtual machines used to run the search engine is modified to reflect changes in workload. We propose an algorithm for incrementally adjusting the index to fit the varying number of virtual machines. We tested its performance using a custom-build prototype search engine deployed in the Amazon EC2 cloud, while calibrating the results to compensate for the performance fluctuations of the platform. Our experiments show that, when compared with computing the index from scratch, the incremental algorithm speeds up the index computation 2–10 times while maintaining a similar search performance.

Publication DOI: https://doi.org/10.1007/978-3-319-25087-8_26
Divisions: Engineering & Applied Sciences > Computer science
Engineering & Applied Sciences > Computer science research group
Related URLs:
Additional Information: © Springer International Publishing Switzerland
Event Title: 8th international conference on Similarity Search and Applications
Event Type: Other
Event Dates: 2015-10-12 - 2015-10-14

Download

[img]

Version: Submitted Version

License: Creative Commons Attribution

Export / Share Citation


Statistics

Additional statistics for this record