Related Researcher

Author's Photo

Jeon, Myeongjae
Research Interests
  • Parallel/distributed processing of deep learning workloads, Real-time stream data analytics at cloud/IoT scale, Public/private blockchain

Streaming Analytics with Adaptive Near-data Processing

Cited 0 times inthomson ciCited 0 times inthomson ci
Streaming Analytics with Adaptive Near-data Processing
Sandur, AtulPark, ChanHoVolos, StavrosAgha, GulJeon, Myeongjae
Issue Date
Association for Computing Machinery, Inc
International World Wide Web Conference
Streaming analytics applications need to process massive volumes of data in a timely manner, in domains ranging from datacenter telemetry and geo-distributed log analytics to Internet-of-Things systems. Such applications suffer from significant network transfer costs to transport the data to a stream processor and compute costs to analyze the data in a timely manner. Pushing the computation closer to the data source by partitioning the analytics query is an effective strategy to reduce resource costs for the stream processor. However, the partitioning strategy depends on the nature of resource bottleneck and resource variability that is encountered at the compute resources near the data source. In this paper, we investigate different issues which affect query partitioning strategies. We first study new partitioning techniques within cloud datacenters which operate under constrained compute conditions varying widely across data sources and different time slots. With insights obtained from the study, we suggest several different ways to improve the performance of stream analytics applications operating in different resource environments, by making effective partitioning decisions for a variety of use cases such as geo-distributed streaming analytics.
Appears in Collections:
CSE_Conference Papers
Files in This Item:
There are no files associated with this item.

find_unist can give you direct access to the published full text of this article. (UNISTARs only)

Show full item record


  • mendeley


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.