The impact of cluster characteristics on HiveQL query optimization

Huge amount of data is stored by different kinds of applications for further analysis. Relational databases were used for decades as data storages, but in some cases they are not suitable for Big Data processing. To solve the problem, non-relational databases were developed. As a help for transferring data from relational databases to non-relational databases, adequate tools were developed. In this paper, a tool named Sqoop is presented. The issue of query optimization should be addressed by all applications that deal with large amounts of data, regardless of their field of application and scope. The impact of cluster characteristics on HiveQL query optimization is analyzed in this paper.