SAT-Hadoop-Processor: A Distributed Remote Sensing Big Data Processing Software for Earth Observation Applications

SAT-Hadoop-Processor: A Distributed Remote Sensing Big Data Processing Software for Earth Observation Applications

Blog Article

Nowadays, several environmental applications take advantage of remote sensing techniques.A considerable volume of this remote sensing data occurs in near real-time.Such data are diverse and are provided with high velocity and variety, their pre-processing requires large computing cath kidston forget me not capacities, and a fast execution time is critical.This paper proposes a new distributed software for remote sensing data pre-processing and ingestion using cloud computing technology, specifically OpenStack.The developed software discarded 86% of the unneeded daily files and removed around 20% of the erroneous and inaccurate datasets.

The parallel processing optimized the total execution time by 90%.Finally, the software efficiently processed and integrated data into the Hadoop storage system, notably the HDFS, HBase, syil x7 price and Hive.