Unable to create a Parquet table in Hive

Problem Description

 

Environment

  • Hadoop distro: MapR 5.2
  • Talend Studio: v6.4.0
  • Hive: 2.0

While creating a Parquet table in Hive, you get this error:

 

[FATAL]: local_project.test_hive_0_1.test_hive - tHiveCreateTable_1 Error while compiling statement: FAILED: SemanticException Cannot find class 'parquet.hive.DeprecatedParquetInputFormat' 
org.apache.hive.service.cli.HiveSQLException: Error while compiling statement: FAILED: SemanticException Cannot find class 'parquet.hive.DeprecatedParquetInputFormat' 
at org.apache.hive.jdbc.Utils.verifySuccess(Utils.java:257) 
at org.apache.hive.jdbc.Utils.verifySuccessWithInfo(Utils.java:243) 
at org.apache.hive.jdbc.HiveStatement.execute(HiveStatement.java:254) 
at local_project.test_hive_0_1.test_hive.tHiveCreateTable_1Process(test_hive.java:941) 
at local_project.test_hive_0_1.test_hive.tHiveConnection_1Process(test_hive.java:736) 
at local_project.test_hive_0_1.test_hive.tLibraryLoad_1Process(test_hive.java:430) 
at local_project.test_hive_0_1.test_hive.runJobInTOS(test_hive.java:1252) 
at local_project.test_hive_0_1.test_hive.main(test_hive.java:1078) 
Caused by: org.apache.hive.service.cli.HiveSQLException: Error while compiling statement: FAILED: SemanticException Cannot find class 'parquet.hive.DeprecatedParquetInputFormat' 
at org.apache.hive.service.cli.operation.Operation.toSQLException(Operation.java:387) 
at org.apache.hive.service.cli.operation.SQLOperation.prepare(SQLOperation.java:193) 
at org.apache.hive.service.cli.operation.SQLOperation.runInternal(SQLOperation.java:276) 
at org.apache.hive.service.cli.operation.Operation.run(Operation.java:324) 
at org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementInternal(HiveSessionImpl.java:499) 
at org.apache.hive.service.cli.session.HiveSessionImpl.executeStatementAsync(HiveSessionImpl.java:486)

 

Root Cause

For the Job to embed the Parquet JAR, the component must define its NameNode URI.

 

Solution

Define "maprfs:///" as the NameNode URI on the tHiveConnection component.

Version history
Revision #:
9 of 9
Last update:
‎04-13-2019 12:42 PM
Updated by: