Related Researcher

Author's Photo

Jeon, Myeongjae
Research Interests
  • Parallel/distributed processing of deep learning workloads, Real-time stream data analytics at cloud/IoT scale, Public/private blockchain


Jarvis: Large-scale Server Monitoring with Adaptive Near-data Processing

DC Field Value Language Atul Sandur ko ChanHo Park ko Stavros Volos ko Gul Agha ko Jeon, Myeongjae ko 2021-12-02T08:10:54Z - 2021-11-29 ko 2022-05-12 ko
dc.identifier.citation IEEE International Conference on Data Engineering ko
dc.identifier.uri -
dc.description.abstract Rapid detection of performance and reliability problems is critical to satisfy availability requirements of a datacenter, which typically consists of a large numbers of servers. To address this, we propose Jarvis, a new stream monitoring system that adaptively partitions monitoring queries for execution across data source and stream processor. Jarvis employs two novel schemes to meet the requirements of large-scale server monitoring scenarios. First, Jarvis processes a subset of the input records on each operator through fine-grained data-level partitioning, allowing even resource-intensive operators to execute under resource constraints on each data source and contribute to reducing the amount of data to transmit over the network to the stream processor. Second, Jarvis makes fast and fully decentralized near-data query refinement decisions guided by an approach combining model-based and model-free heuristics, enabling quick adaptation to dynamic resource conditions on each data source. We evaluate the effectiveness of Jarvis on a diverse set of monitoring queries and scales. As compared to the existing schemes, Jarvis handles up to 75% more data source nodes while improving throughput in resource-constrained scenarios by 1.2–4.4×. Moreover, Jarvis achieves these improvements while being able to converge to a stable query partition within a few seconds of a resource change that occurs on data source. ko
dc.language 영어 ko
dc.publisher 38th IEEE International Conference on Data Engineering ko
dc.title Jarvis: Large-scale Server Monitoring with Adaptive Near-data Processing ko
dc.type CONFERENCE ko
dc.type.rims CONF ko
Appears in Collections:
CSE_Conference Papers

find_unist can give you direct access to the published full text of this article. (UNISTARs only)

Show simple item record


  • mendeley


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.