There are no files associated with this item.
Full metadata record
DC Field | Value | Language |
---|---|---|
dc.citation.conferencePlace | US | - |
dc.citation.endPage | 1346 | - |
dc.citation.startPage | 1337 | - |
dc.citation.title | IEEE International Conference on Big Data, Big Data | - |
dc.contributor.author | Bao, S. | - |
dc.contributor.author | Parvarthaneni, P. | - |
dc.contributor.author | Huo, Y. | - |
dc.contributor.author | Barve, Y. | - |
dc.contributor.author | Plassard, A.J. | - |
dc.contributor.author | Yao, Y. | - |
dc.contributor.author | Sun, H. | - |
dc.contributor.author | Lyu, I. | - |
dc.contributor.author | Zald, D.H. | - |
dc.contributor.author | Landman, B.A. | - |
dc.contributor.author | Gokhale, A. | - |
dc.date.accessioned | 2024-02-01T00:41:11Z | - |
dc.date.available | 2024-02-01T00:41:11Z | - |
dc.date.created | 2021-03-09 | - |
dc.date.issued | 2018-12-10 | - |
dc.description.abstract | Big data medical image processing applications involving multi-stage analysis often exhibit significant variability in processing times ranging from a few seconds to several days. Moreover, due to the sequential nature of executing the analysis stages enforced by traditional software technologies and platforms, any errors in the pipeline are only detected at the later stages despite the sources of errors predominantly being the highly compute-intensive first stage. This wastes precious computing resources and incurs prohibitively higher costs for re-executing the application. The medical image processing community to date remains largely unaware of these issues and continues to use traditional high-performance computing clusters, which incur a high operating cost due to the use of dedicated resources and expensive centralized file systems. To overcome these challenges, this paper proposes an alternative approach for multi-stage analysis in medical image processing by using the Apache Hadoop ecosystem and offering it as a service in the cloud. We make the following contributions. First, we propose a concurrent pipeline execution framework and an associated semi-automatic, real-time monitoring and checkpointing framework that can detect outliers and achieve quality assurance without having to completely execute the expensive first stage of processing thereby expediting the entire multi-stage analysis. Second, we present a simulator to rapidly estimate the execution time for a given multi-stage analysis, which can aid the users in deciding the appropriate approach for their use cases. We conduct empirical evaluation of our framework and show that it requires 76.75% lesser wall time and 29.22% lesser resource time compared to the traditional approach that lacks such a quality assurance mechanism. © 2018 IEEE. | - |
dc.identifier.bibliographicCitation | IEEE International Conference on Big Data, Big Data, pp.1337 - 1346 | - |
dc.identifier.doi | 10.1109/BigData.2018.8622624 | - |
dc.identifier.scopusid | 2-s2.0-85062625224 | - |
dc.identifier.uri | https://scholarworks.unist.ac.kr/handle/201301/80299 | - |
dc.language | 영어 | - |
dc.publisher | Institute of Electrical and Electronics Engineers Inc. | - |
dc.title | Technology Enablers for Big Data, Multi-Stage Analysis in Medical Image Processing | - |
dc.type | Conference Paper | - |
dc.date.conferenceDate | 2018-12-10 | - |
Items in Repository are protected by copyright, with all rights reserved, unless otherwise indicated.
Tel : 052-217-1404 / Email : scholarworks@unist.ac.kr
Copyright (c) 2023 by UNIST LIBRARY. All rights reserved.
ScholarWorks@UNIST was established as an OAK Project for the National Library of Korea.