BROWSE

Related Researcher

Author's Photo

Nam, Beomseok
Data Intensive Computing Lab
Research Interests
  • Distributed and parallel computing, high performance computing, database systems, OS and storage systems

ITEM VIEW & DOWNLOAD

EM-KDE: A locality-aware job scheduling policy with distributed semantic caches

Cited 0 times inthomson ciCited 0 times inthomson ci
Title
EM-KDE: A locality-aware job scheduling policy with distributed semantic caches
Author
Eom, YoungmoonHwang, DeukyeonLee, JunyongMoon, JonghwanShin, MinhoNam, Beomseok
Issue Date
2015-09
Publisher
ACADEMIC PRESS INC ELSEVIER SCIENCE
Citation
JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, v.83, pp.119 - 132
Abstract
In modern query processing systems, the caching facilities are distributed and scale with the number of servers. To maximize the overall system throughput, the distributed system should balance the query loads among servers and also leverage cached results. In particular, leveraging distributed cached data is becoming more important as many systems are being built by connecting many small heterogeneous machines rather than relying on a few high-performance workstations. Although many query scheduling policies exist such as round-robin and load-monitoring, they are not sophisticated enough to both balance the load and leverage cached results. In this paper, we propose distributed query scheduling policies that take into account the dynamic contents of distributed caching infrastructure and employ statistical prediction methods into query scheduling policy. We employ the kernel density estimation derived from recent queries and the well-known exponential moving average (EMA) in order to predict the query distribution in a multi-dimensional problem space that dynamically changes. Based on the estimated query distribution, the front-end scheduler assigns incoming queries so that query workloads are balanced and cached results are reused. Our experiments show that the proposed query scheduling policy outperforms existing policies in terms of both load balancing and cache hit ratio. (C) 2015 Elsevier Inc. All rights reserved
URI
https://scholarworks.unist.ac.kr/handle/201301/16428
URL
http://www.sciencedirect.com/science/article/pii/S0743731515001008#
DOI
10.1016/j.jpdc.2015.06.002
ISSN
0743-7315
Appears in Collections:
ECE_Journal Papers
Files in This Item:
There are no files associated with this item.

find_unist can give you direct access to the published full text of this article. (UNISTARs only)

Show full item record

qrcode

  • mendeley

    citeulike

Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.

MENU