Benchmark Comparison of Cloud Analytics Methods Applied to Earth Observations

Special Publications Big Data Analytics in Earth, Atmospheric, and Ocean Sciences(2022)

引用 0|浏览26
暂无评分
摘要
Earth observation data are a vital resource for studying long-term changes, but the large data volumes can be challenging to analyze. Time-series analysis in particular is hampered by the typical thin-time-slice file organization. We examine several potential solutions inspired in large part by the data-parallel methods that have arisen with cloud computing. These solutions include various combinations of data reorganization, spatial indexing, distributed storage, and pre-computation that we term Analytics Optimized Data Stores (AODS) . We find that even simple solutions (such as a data cube) produce more than an order of magnitude improvement; the best provide two to three orders of magnitude improvement. The most performant solutions have tradeoffs in terms of generality or storage footprint, but may nonetheless be useful components in data analytics frameworks where performance is critical.
更多
查看译文
AI 理解论文
溯源树
样例
生成溯源树,研究论文发展脉络
Chat Paper
正在生成论文摘要