"Multiple continuous top-K queries over data stream" by Rui ZHU, Yujin JIA et al.
 

Publication Type

Conference Proceeding Article

Version

acceptedVersion

Publication Date

5-2024

Abstract

Continuous top-k" role="presentation" style="box-sizing: border-box; display: inline-block; line-height: 0; font-size: 18.72px; font-size-adjust: none; overflow-wrap: normal; word-spacing: normal; text-wrap-mode: nowrap; float: none; direction: ltr; max-width: none; max-height: none; min-width: 0px; min-height: 0px; border: 0px; margin: 0px; padding: 1px 0px; position: relative;">kk query over sliding window is a fundamental challenge in the domain of streaming data management. Specifically, a continuous top-k query q" role="presentation" style="box-sizing: border-box; display: inline-block; line-height: 0; font-size: 18.72px; font-size-adjust: none; overflow-wrap: normal; word-spacing: normal; text-wrap-mode: nowrap; float: none; direction: ltr; max-width: none; max-height: none; min-width: 0px; min-height: 0px; border: 0px; margin: 0px; padding: 1px 0px; position: relative;">qq monitors the window W" role="presentation" style="box-sizing: border-box; display: inline-block; line-height: 0; font-size: 18.72px; font-size-adjust: none; overflow-wrap: normal; word-spacing: normal; text-wrap-mode: nowrap; float: none; direction: ltr; max-width: none; max-height: none; min-width: 0px; min-height: 0px; border: 0px; margin: 0px; padding: 1px 0px; position: relative;">WW, returning the k" role="presentation" style="box-sizing: border-box; display: inline-block; line-height: 0; font-size: 18.72px; font-size-adjust: none; overflow-wrap: normal; word-spacing: normal; text-wrap-mode: nowrap; float: none; direction: ltr; max-width: none; max-height: none; min-width: 0px; min-height: 0px; border: 0px; margin: 0px; padding: 1px 0px; position: relative;">kk objects with the highest scores to the system with each slide of the window. This paper delves into one of its important variants, referred to as multiple continuous top. k" role="presentation" style="box-sizing: border-box; display: inline-block; line-height: 0; font-size: 18.72px; font-size-adjust: none; overflow-wrap: normal; word-spacing: normal; text-wrap-mode: nowrap; float: none; direction: ltr; max-width: none; max-height: none; min-width: 0px; min-height: 0px; border: 0px; margin: 0px; padding: 1px 0px; position: relative;">kk queries over data stream, which holds significant applications. While various efforts have been made to support continuous top-k query, few have addressed the complexities of multiple continuous top-k queries. The prevailing approach involves selecting a minimal number of objects in the window as candidates, incrementally maintaining them, and using them to support query processing as efficiently as possible. However, these endeavors exhibit sensitivity to the query workload scale or query parameters such as k" role= "presentation" style="box-sizing: border-box; display: inline-block; line-height: 0; font-size: 18.72px; font-size-adjust: none; overflow-wrap: normal; word-spacing: normal; text-wrap-mode: nowrap; float: none; direction: ltr; max-width: none; max-height: none; min-width: 0px; min-height: 0px; border: 0px; margin: 0px; padding: 1px 0px; position: relative;">kk, the window length n" role="presentation" style="box-sizing: border-box; display: inline-block; line-height: 0; font-size: 18.72px; font-size-adjust: none; overflow-wrap: normal; word-spacing: normal; text-wrap-mode: no wrap; float: none; direction: ltr; max-width: none; max-height: none; min-width: 0px; min-height: 0px; border: 0px; margin: 0px; padding: 1px 0px; position: relative;">nn, and others. Consequently, they incur high running/space cost in updating the candidate set. In this paper, we propose a novel index PH-Tree (Partition and Heap-based Binary Tree), designed to facilitate multiple continuous top-k queries. We partition the query window into a group of disjoint partitions and use PH-Tree to organize these partitions. Additionally, the PH-Tree allows for flexible candidate selection based on the size of each partition, parameter distribution of queries and score distribution of objects. We further develop a group of efficient algorithms to support candidate set incremental maintenance and query processing. The effectiveness and efficiency of the proposed algorithms are validated through extensive theoretical analysis and experiments detailed in this paper.

Keywords

Sensitivity, Costs, Query processing, Binary trees, Data engineering, Partitioning algorithms, Maintenance

Discipline

Databases and Information Systems

Research Areas

Data Science and Engineering

Publication

2024 IEEE 40th International Conference on Data Engineering (ICDE), Utrecht, Netherlands, May 13-16: Proceedings

First Page

1575

Last Page

1588

ISBN

9798350317169

Identifier

10.1109/ICDE60146.2024.00129

Publisher

IEEE Computer Society

City or Country

Los Alamitos, CA

Copyright Owner and License

Authors

Additional URL

https://doi.org/10.1109/ICDE60146.2024.00129

Share

COinS