EM-KDE: A locality-aware job scheduling policy with distributed semantic caches
Cited 0 times inCited 0 times in
- EM-KDE: A locality-aware job scheduling policy with distributed semantic caches
- Eom, Youngmoon; Hwang, Deukyeon; Lee, Junyong; Moon, Jonghwan; Shin, Minho; Nam, Beomseok
- Issue Date
- ACADEMIC PRESS INC ELSEVIER SCIENCE
- JOURNAL OF PARALLEL AND DISTRIBUTED COMPUTING, v.83, pp.119 - 132
- In modern query processing systems, the caching facilities are distributed and scale with the number of servers. To maximize the overall system throughput, the distributed system should balance the query loads among servers and also leverage cached results. In particular, leveraging distributed cached data is becoming more important as many systems are being built by connecting many small heterogeneous machines rather than relying on a few high-performance workstations. Although many query scheduling policies exist such as round-robin and load-monitoring, they are not sophisticated enough to both balance the load and leverage cached results. In this paper, we propose distributed query scheduling policies that take into account the dynamic contents of distributed caching infrastructure and employ statistical prediction methods into query scheduling policy. We employ the kernel density estimation derived from recent queries and the well-known exponential moving average (EMA) in order to predict the query distribution in a multi-dimensional problem space that dynamically changes. Based on the estimated query distribution, the front-end scheduler assigns incoming queries so that query workloads are balanced and cached results are reused. Our experiments show that the proposed query scheduling policy outperforms existing policies in terms of both load balancing and cache hit ratio. (C) 2015 Elsevier Inc. All rights reserved
- Appears in Collections:
- ECE_Journal Papers
- Files in This Item:
- There are no files associated with this item.
can give you direct access to the published full text of this article. (UNISTARs only)
Show full item record
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.