One Star

Sqoop Export to MySQL issue

Hi,
I am using talend platform for MDM Big Data 5.3.1. r104014 on Windows 7 with Hortonworks HDP v1.2.0 Bimota
Exporting a simple table from HDFS to MySQL t00_stocks with 5 rows faails. Please help.

Error log
Starting job t11_Sqoop_Export_fromHDFS_toMySQL at 22:11 06/03/2014.

connecting to socket on port 3727
connected
14/03/06 22:11:46 WARN sqoop.ConnFactory: $SQOOP_CONF_DIR has not been set in the environment. Cannot check for additional configuration.
14/03/06 22:11:46 DEBUG sqoop.ConnFactory: Loaded manager factory: com.cloudera.sqoop.manager.DefaultManagerFactory
14/03/06 22:11:46 DEBUG sqoop.ConnFactory: Trying ManagerFactory: com.cloudera.sqoop.manager.DefaultManagerFactory
14/03/06 22:11:46 DEBUG manager.DefaultManagerFactory: Trying with scheme: jdbc:mysql:
14/03/06 22:11:46 INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset.
14/03/06 22:11:46 DEBUG sqoop.ConnFactory: Instantiated ConnManager org.apache.sqoop.manager.MySQLManager@100ce93f
14/03/06 22:11:46 INFO tool.CodeGenTool: Beginning code generation
14/03/06 22:11:46 DEBUG manager.SqlManager: No connection paramenters specified. Using regular API for making connection.
14/03/06 22:11:47 DEBUG manager.SqlManager: Using fetchSize for next query: -2147483648
14/03/06 22:11:47 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `t00_stocks` AS t LIMIT 1
14/03/06 22:11:47 DEBUG orm.ClassWriter: selected columns:
14/03/06 22:11:47 DEBUG orm.ClassWriter: id
14/03/06 22:11:47 DEBUG orm.ClassWriter: stock_symbol
14/03/06 22:11:47 DEBUG orm.ClassWriter: price
14/03/06 22:11:47 DEBUG orm.ClassWriter: category
14/03/06 22:11:47 DEBUG manager.SqlManager: Using fetchSize for next query: -2147483648
14/03/06 22:11:47 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `t00_stocks` AS t LIMIT 1
14/03/06 22:11:47 DEBUG orm.ClassWriter: Writing source file: \tmp\sqoop-Amit\compile\a68839d0bd16f8b56d88816955390ddb\t00_stocks.java
14/03/06 22:11:47 DEBUG orm.ClassWriter: Table name: t00_stocks
14/03/06 22:11:47 DEBUG orm.ClassWriter: Columns: id:12, stock_symbol:12, price:12, category:12,
14/03/06 22:11:47 DEBUG orm.ClassWriter: sourceFilename is t00_stocks.java
disconnected
14/03/06 22:11:47 DEBUG orm.CompilationManager: Found existing \tmp\sqoop-Amit\compile\a68839d0bd16f8b56d88816955390ddb\
14/03/06 22:11:47 INFO orm.CompilationManager: $HADOOP_HOME is not set
14/03/06 22:11:47 ERROR orm.CompilationManager: It seems as though you are running sqoop with a JRE.
14/03/06 22:11:47 ERROR orm.CompilationManager: Sqoop requires a JDK that can compile Java code.
14/03/06 22:11:47 ERROR orm.CompilationManager: Please install a JDK and set $JAVA_HOME to use it.
14/03/06 22:11:47 ERROR tool.ExportTool: Encountered IOException running export job: java.io.IOException: Could not start Java compiler.
Exception in component tSqoopExport_1
java.lang.Exception: The Sqoop export job has failed
at t01_bd_bimota_01.t11_sqoop_export_fromhdfs_tomysql_0_1.t11_Sqoop_Export_fromHDFS_toMySQL.tSqoopExport_1Process(t11_Sqoop_Export_fromHDFS_toMySQL.java:657)
at t01_bd_bimota_01.t11_sqoop_export_fromhdfs_tomysql_0_1.t11_Sqoop_Export_fromHDFS_toMySQL.runJobInTOS(t11_Sqoop_Export_fromHDFS_toMySQL.java:1005)
at t01_bd_bimota_01.t11_sqoop_export_fromhdfs_tomysql_0_1.t11_Sqoop_Export_fromHDFS_toMySQL.main(t11_Sqoop_Export_fromHDFS_toMySQL.java:743)
Job t11_Sqoop_Export_fromHDFS_toMySQL ended at 22:11 06/03/2014.
2 REPLIES
One Star

Re: Sqoop Export to MySQL issue

Hi,
It looks like you dont have JDK version installed on your machine were you are executing talend job.
Install java JDK and go to the preferences -> talend -> mention the path of java interpreter i.e. java.exe from jdk bin directory.

Regards
Gokul
Moderator

Re: Sqoop Export to MySQL issue

Hi,
For your talend platform for MDM Big Data product, you'd better report a ticket on Talend Support Portal, our colleagues from support team will schedule a webex with you to give a remote assistance.
Best regards
Sabrina
--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.