Title :
Task-Tree Based Large-Scale Mosaicking for Massive Remote Sensed Imageries with Dynamic DAG Scheduling
Author :
Yan Ma ; Lizhe Wang ; Zomaya, Albert Y. ; Dan Chen ; Ranjan, Rajiv
Author_Institution :
Inst. of Remote Sensing & Digital Earth, Beijing, China
Abstract :
Remote sensed imagery mosaicking at large scale has been receiving increasing attentions in regional to global research. However, when scaling to large areas, image mosaicking becomes extremely challenging for the dependency relationships among a large collection of tasks which give rise to ordering constraint, the demand of significant processing capabilities and also the difficulties inherent in organizing these enormous tasks and RS image data. We propose a task-tree based mosaicking for remote sensed imageries at large scale with dynamic DAG scheduling. It expresses large scale mosaicking as a data-driven task tree with minimal height. And also a critical path based dynamical DAG scheduling solution with status queue named CPDS-SQ is provided to offer an optimized schedule on multi-core cluster with minimal completion time. All the individual dependent tasks are run by a core parallel mosaicking program implemented with MPI to perform mosaicking on different pairs of images. Eventually, an effective but easier approach is offered to improve the large-scale processing capability by decoupling the dependence relationships among tasks from the complex parallel processing procedure. Through experiments on large-scale mosaicking, we confirmed that our approach were efficient and scalable.
Keywords :
directed graphs; geophysical image processing; image segmentation; multiprocessing systems; remote sensing; trees (mathematics); CPDS-SQ; data-driven task tree; dependence relationship; directed acyclic graph; dynamical DAG scheduling solution with status queue; image mosaicking; massive remote sensed imagery; multicore cluster; ordering constraint; parallel processing procedure; task-tree based large-scale mosaicking; Dynamic scheduling; Processor scheduling; Radiometry; Remote sensing; Schedules; DAG scheduling; Remote sensing image processing; big data computing; data-intensive computing; parallel computing;
Journal_Title :
Parallel and Distributed Systems, IEEE Transactions on
DOI :
10.1109/TPDS.2013.272