One Star

tsqoopimport error

Hi,
I am getting the error when I am using the tsqoopimport to load the data to HDFS from MySQL.
Even I have used the tLibraryLoad to load "mysql-connector-java-5.1.37-bin.jar" & "sqoop-1.4.2.21.jar".
Screenshots are uploaded.

Please find the error below:
Starting job sqoop_to_hdfs at 23:40 03/11/2015.
connecting to socket on port 3602
connected
: org.apache.hadoop.util.NativeCodeLoader - Unable to load native-hadoop library for your platform... using builtin-java classes where applicable
: org.apache.hadoop.util.Shell - Failed to locate the winutils binary in the hadoop binary path
java.io.IOException: Could not locate executable null\bin\winutils.exe in the Hadoop binaries.
at org.apache.hadoop.util.Shell.getQualifiedBinPath(Shell.java:355)
at org.apache.hadoop.util.Shell.getWinUtilsPath(Shell.java:370)
at org.apache.hadoop.util.Shell.<clinit>(Shell.java:363)
at org.apache.hadoop.util.StringUtils.<clinit>(StringUtils.java:79)
at org.apache.hadoop.security.Groups.parseStaticMapping(Groups.java:104)
at org.apache.hadoop.security.Groups.<init>(Groups.java:86)
at org.apache.hadoop.security.Groups.<init>(Groups.java:66)
at org.apache.hadoop.security.Groups.getUserToGroupsMappingService(Groups.java:280)
at org.apache.hadoop.security.UserGroupInformation.initialize(UserGroupInformation.java:271)
at org.apache.hadoop.security.UserGroupInformation.ensureInitialized(UserGroupInformation.java:248)
at org.apache.hadoop.security.UserGroupInformation.loginUserFromSubject(UserGroupInformation.java:763)
at org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:748)
at org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:621)
at org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:2753)
at org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:2745)
at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:2611)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:370)
at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:169)
at ftfcu.sqoop_to_hdfs_0_1.sqoop_to_hdfs.tSqoopImport_1Process(sqoop_to_hdfs.java:657)
at ftfcu.sqoop_to_hdfs_0_1.sqoop_to_hdfs.tLibraryLoad_1Process(sqoop_to_hdfs.java:552)
at ftfcu.sqoop_to_hdfs_0_1.sqoop_to_hdfs.tLibraryLoad_2Process(sqoop_to_hdfs.java:440)
at ftfcu.sqoop_to_hdfs_0_1.sqoop_to_hdfs.runJobInTOS(sqoop_to_hdfs.java:1094)
at ftfcu.sqoop_to_hdfs_0_1.sqoop_to_hdfs.main(sqoop_to_hdfs.java:945)
: org.apache.sqoop.ConnFactory - $SQOOP_CONF_DIR has not been set in the environment. Cannot check for additional configuration.
Note: \tmp\sqoop-SYakkala\compile\0b10b08dde744da71482faa9ca761012\emp.java uses or overrides a deprecated API.
Note: Recompile with -Xlint:deprecation for details.
: org.apache.sqoop.manager.MySQLManager - It looks like you are importing from mysql.
: org.apache.sqoop.manager.MySQLManager - This transfer can be faster! Use the --direct
: org.apache.sqoop.manager.MySQLManager - option to exercise a MySQL-specific fast path.
: org.apache.sqoop.tool.ImportTool - Encountered IOException running import job: java.io.IOException: Could not load jar \tmp\sqoop-SYakkala\compile\0b10b08dde744da71482faa9ca761012\emp.jar into JVM. (Could not find class emp.)
at org.apache.sqoop.util.ClassLoaderStack.addJarFile(ClassLoaderStack.java:92)
at com.cloudera.sqoop.util.ClassLoaderStack.addJarFile(ClassLoaderStack.java:36)
at org.apache.sqoop.mapreduce.JobBase.loadJars(JobBase.java:230)
at org.apache.sqoop.mapreduce.ImportJobBase.runImport(ImportJobBase.java:192)
at org.apache.sqoop.manager.SqlManager.importTable(SqlManager.java:465)
at org.apache.sqoop.manager.MySQLManager.importTable(MySQLManager.java:108)
at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:403)
at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:476)
at org.apache.sqoop.Sqoop.run(Sqoop.java:145)
at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:181)
at ftfcu.sqoop_to_hdfs_0_1.sqoop_to_hdfs.tSqoopImport_1Process(sqoop_to_hdfs.java:692)
at ftfcu.sqoop_to_hdfs_0_1.sqoop_to_hdfs.tLibraryLoad_1Process(sqoop_to_hdfs.java:552)
at ftfcu.sqoop_to_hdfs_0_1.sqoop_to_hdfs.tLibraryLoad_2Process(sqoop_to_hdfs.java:440)
at ftfcu.sqoop_to_hdfs_0_1.sqoop_to_hdfs.runJobInTOS(sqoop_to_hdfs.java:1094)
at ftfcu.sqoop_to_hdfs_0_1.sqoop_to_hdfs.main(sqoop_to_hdfs.java:945)
Caused by: java.lang.ClassNotFoundException: emp
at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
at java.security.AccessController.doPrivileged(Native Method)
at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
at java.net.FactoryURLClassLoader.loadClass(URLClassLoader.java:789)
at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
at java.lang.Class.forName0(Native Method)
at java.lang.Class.forName(Class.java:274)
at org.apache.sqoop.util.ClassLoaderStack.addJarFile(ClassLoaderStack.java:88)
... 15 more
Exception in component tSqoopImport_1
java.lang.Exception: The Sqoop import job has failed. Please check the logs.
at ftfcu.sqoop_to_hdfs_0_1.sqoop_to_hdfs.tSqoopImport_1Process(sqoop_to_hdfs.java:696)
at ftfcu.sqoop_to_hdfs_0_1.sqoop_to_hdfs.tLibraryLoad_1Process(sqoop_to_hdfs.java:552)
at ftfcu.sqoop_to_hdfs_0_1.sqoop_to_hdfs.tLibraryLoad_2Process(sqoop_to_hdfs.java:440)
at ftfcu.sqoop_to_hdfs_0_1.sqoop_to_hdfs.runJobInTOS(sqoop_to_hdfs.java:1094)
at ftfcu.sqoop_to_hdfs_0_1.sqoop_to_hdfs.main(sqoop_to_hdfs.java:945)
disconnected
Job sqoop_to_hdfs ended at 23:40 03/11/2015.
6 REPLIES
One Star

Re: tsqoopimport error

screenshots are here :
One Star

Re: tsqoopimport error

screenshots are uploaded. My apologies for multiple messages.
Moderator

Re: tsqoopimport error

Hi,

Can you upload again the screenshots you wanted to show, please? For some reason it didn't make it to your post.(you can edit your previous posts and post your screenshot).

Best regards
Sabrina
--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
One Star

Re: tsqoopimport error

Hi,
Please find the screenshots:

  
One Star

Re: tsqoopimport error

please help me regarding this error...
Moderator

Re: tsqoopimport error

Hi,
Here is a kb article about TalendHelpCenter:The missing winutils.exe program in the Big Data Jobs
Best regards
Sabrina
--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.