DEPA - Delta shifting and distribution shaping for efficient adaptive indexing
File(s)
Accepted version
Author(s)
Khazaie, Ahmad
Pirk, Holger
Type
Conference Paper
Abstract
In dynamic environments, such as exploratory data analysis where the query and data workload changes frequently, the absence of prior knowledge about the workload poses a significant challenge in defining appropriate indices for a database. Frequent changes in the workload demand prompt response times for queries to increase user satisfaction, making it crucial to adapt the index dynamically. To address these challenges, adaptive indexing has emerged as a promising solution. The fundamental idea is to build the index incrementally during query processing. However, state-of-the-art adaptive indexing approaches under-utilize hardware resources, while progressive indexes sacrifice adaptivity to the workload. In this paper, we propose two novel techniques, namely Delta Shift Partitioning and Distribution Shaping Partitioning, that achieve tenfold better performance than the competitors without compromising the adaptivity of the index. Through low-level tuning and efficient hardware implementation, our proposed methods offer an optimal and adaptive solution to address the challenges of real-time query processing in dynamic workloads.
Date Issued
2025-05-19
Date Acceptance
2024-11-27
Citation
2025 IEEE 41st International Conference on Data Engineering (ICDE), 2025, pp.197-209
ISBN
979-8-3315-3603-9
ISSN
2375-026X
Publisher
IEEE Computer Society
Start Page
197
End Page
209
Journal / Book Title
2025 IEEE 41st International Conference on Data Engineering (ICDE)
Copyright Statement
Copyright © 2025 by The Institute of Electrical and Electronics Engineers, Inc. This is the author’s accepted manuscript made available under a CC-BY licence in accordance with Imperial’s Research Publications Open Access policy (www.imperial.ac.uk/oa-policy)
License URL
Source
2025 IEEE 41st International Conference on Data Engineering (ICDE)
Publication Status
Published
Start Date
2025-05-19
Finish Date
2025-05-23
Coverage Spatial
Hong Kong