'No manager' error when connecting to Vertica database with tSqoopImport component

Talend Version       6.3.1

Summary

 
Additional Versions  
Product Big Data
Component Hadoop Access
Problem Description

When executing a Talend 6.3.1 Job with a tSqoopImport component that imports data from a Vertica database to a Hadoop Cluster, it fails with the following exception:

[ERROR]: org.apache.sqoop.tool.BaseSqoopTool - Got error creating database manager: java.io.IOException: 
No manager for connect string: jdbc:vertica://tlnd.local:5433/hlsmtc_dev
at org.apache.sqoop.ConnFactory.getManager(ConnFactory.java:191)
at org.apache.sqoop.tool.BaseSqoopTool.init(BaseSqoopTool.java:264)
at org.apache.sqoop.tool.ImportTool.init(ImportTool.java:89)
at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:603)
at org.apache.sqoop.Sqoop.run(Sqoop.java:147)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:183)
at local_project.test_sqoop_vertica_0_1.Test_sqoop_vertica.tSqoopImport_1Process(Test_sqoop_vertica.java:541)
Problem root cause

The Sqoop Supported Databases page lists the databases for which Sqoop includes vendor-specific support, but Vertica is not in the list. So a generic manager and Vertica JDBC driver class (specified in tSqoopImport) have to be provided by Talend.

Solution or Workaround

This problem is fixed against the following versions: 6.4.2, 6.5.1, 6.3.3.

 

Against Talend 6.3.1, one solution is to apply Patch_20171004_TPS-2161_v2-6.3.1.zip. To implement this solution, this patch can be applied manually:

  1. Create a folder named patches under your Studio installer directory.
  2. Copy Patch_20171004_TPS-2161_v2-6.3.1.zip to this folder.
  3. Restart Talend Studio. When a prompt window is displayed, click OK to install the patch.

 

Another option is to configure a tSqoopImport component in Advanced Settings > Additional Arguments as follows:

  • Provide the Vertica JDBC driver class: set the "jdbc.driver.class" argument with value "com.vertica.jdbc.Driver".
  • Provide the sqoop manager class: set the "connection-manager" argument with value "org.apache.sqoop.manager.GenericJdbcManager".
JIRA ticket number  
Version history
Revision #:
7 of 7
Last update:
‎02-09-2018 08:08 PM
Updated by:
 
Contributors