Regrouping metric-space search index for search engine size adaptation

Abstract

This work contributes to the development of search engines that self-adapt their size in response to fluctuations in workload. Deploying a search engine in an Infrastructure as a Service (IaaS) cloud facilitates allocating or deallocating computational resources to or from the engine. In this paper, we focus on the problem of regrouping the metric-space search index when the number of virtual machines used to run the search engine is modified to reflect changes in workload. We propose an algorithm for incrementally adjusting the index to fit the varying number of virtual machines. We tested its performance using a custom-build prototype search engine deployed in the Amazon EC2 cloud, while calibrating the results to compensate for the performance fluctuations of the platform. Our experiments show that, when compared with computing the index from scratch, the incremental algorithm speeds up the index computation 2–10 times while maintaining a similar search performance.

Publication DOI: https://doi.org/10.1007/978-3-319-25087-8_26
Divisions: ?? 50811700Jl ??
Additional Information: © Springer International Publishing Switzerland
Event Title: 8th international conference on Similarity Search and Applications
Event Type: Other
Event Dates: 2015-10-12 - 2015-10-14
ISBN: 978-3-319-25086-1, 978-3-319-25087-8
Last Modified: 26 Mar 2024 08:07
Date Deposited: 22 Oct 2015 08:40
Full Text Link: http://link.spr ... -319-25087-8_26
Related URLs: http://www.scop ... tnerID=8YFLogxK (Scopus URL)
PURE Output Type: Conference contribution
Published Date: 2015-10-17
Authors: Al Ruqeishi, Khalil
Konečný, Michal (ORCID Profile 0000-0003-2374-9017)

Download

[img]

Version: Accepted Version

License: Creative Commons Attribution


Export / Share Citation


Statistics

Additional statistics for this record