Dynamic Table: A Scalable Storage Structure in the Cloud.

Big data bring us not only constantly growing data volume, dynamic and elastic storage demands, diversified data structures, but also different data features. Apart from the traditional dense data, more and more "sparse" data emerged and account for the majority of the massive data. How to adapt to the characteristics of the sparse data without losing sight of the traits of the dense data is a challenge. This paper studies how to integrate row and column data-layouts for both dense and sparse datasets in the cloud. A new NF2 scalable storage structure named "Dynamic Table" based on the key-value storage is proposed. The formal definition of dynamic table and implemention on HDFS is also introduced. © 2013 Springer-Verlag.