Understanding Hive Versions¶
QDS supports the following versions of Hive:
- Hive 2.1.1 (works with Tez 0.8.4 and Hadoop 2.6.0)
- Hive 2.3 (works with Tez 0.8.4 and Hadoop 2.6.0)
Using Different Versions of Hive on QDS¶
The various ways of running Hive using these versions are described in Understanding Different Ways to Run Hive. Hadoop 2 clusters are also known as Hadoop 2 (Hive) clusters.
Use the different versions of Hive on QDS as described below:
| Hive Version | QDS Server | Hive-on-Coordinator | HiveServer 2 | Multi-instance HiveServer2 |
|---|---|---|---|---|
| 2.1.1 | Self-serve support | Default | Self-serve Support | Contact QDS Support to enable |
| 2.3 | Default | Running Hive on the Coordinator Node | Self-serve Support | Contact QDS Support to enable |
Note
- LLAP from the Hive open source is not verified in Qubole’s Hive 2.1.1.
- The
/media/ephemeral0/hive1.2/metastore.propertiesfile has been deleted from Hive 2.3 onwards. Remove the dependency on themetastore.propertiesfile if you use this version. Hive 2.3 uses Java 8 while running on QDS servers. It is also compatible with Java 7.
To configure a version, select it from the Hive Version drop-down list when you configure a Hadoop 2 (Hive) cluster in QDS. Create a ticket with Qubole Support for an account-wide configuration. This enables all clusters in the account to use Hive on Coordinator. For more information, see hive-on-cluster-master.
To use Hive Server 2, enable Hive Server 2 under the Advanced Configuration tab of the Hadoop 2 (Hive) cluster. For more information, see Configuring a HiveServer2 Cluster. You can set the versions through the API as described in hive-server-api-parameter.
To run Hive queries on Hive-on-coordinator, refer to hive-on-cluster-master-how. If Hive 2.x queries do not run on QDS servers by default, they run on the coordinator by default.
If you enable Hive Server 2, Hive queries run through HiveServer2.