One Star

[resolved] hive-site.xml not found on CLASSPATH

Hi,
I use Talend 5.1 et and i have a Hive connection but i got a message error concerning the hive_site.xml

démarrage du job job_connect_2 a 15:03 13/09/2012.
connecting to socket on port 3977
connected
12/09/13 15:03:36 WARN conf.HiveConf: hive-site.xml not found on CLASSPATH
12/09/13 15:03:36 INFO metastore.HiveMetaStore: 0: Opening raw store with implemenation classSmiley Surprisedrg.apache.hadoop.hive.metastore.ObjectStore
12/09/13 15:03:36 INFO metastore.ObjectStore: ObjectStore, initialize called
12/09/13 15:03:36 INFO DataNucleus.Persistence: Property datanucleus.cache.level2 unknown - will be ignored
12/09/13 15:03:36 INFO DataNucleus.Persistence: Property javax.jdo.option.NonTransactionalRead unknown - will be ignored
12/09/13 15:03:36 INFO DataNucleus.Persistence: ================= Persistence Configuration ===============
12/09/13 15:03:36 INFO DataNucleus.Persistence: DataNucleus Persistence Factory - Vendor: "DataNucleus" Version: "2.0.3"
12/09/13 15:03:36 INFO DataNucleus.Persistence: DataNucleus Persistence Factory initialised for datastore URL="jdbc:derby:;databaseName=metastore_db;create=true" driver="org.apache.derby.jdbc.EmbeddedDriver" userName="APP"
12/09/13 15:03:36 INFO DataNucleus.Persistence:

Could you please tell me in which directory i must put the hive_site.xml and how to configure it ?

Thanks

  • Big Data
20 REPLIES
Community Manager

Re: [resolved] hive-site.xml not found on CLASSPATH

Hi
It is an issue of hive, see
https://issues.apache.org/jira/browse/HIVE-1933?page=com.atlassian.jira.plugin.system.issuetabpanels...
----------------------------------------------------------
Talend | Data Agility for Modern Business
One Star

Re: [resolved] hive-site.xml not found on CLASSPATH

Hi,
It is still an issue, i got someone from Talend in France, he told me to put the file hive-site.xml in the directory :
C:\TALEND_FOR_BIG_DATA\TOS_BD-r84309-V5.1.1\lib or C:\TALEND_FOR_BIG_DATA\TOS_BD-r84309-V5.1.1\lib\java
but the issue still exists.
I downloaded the Talend version 5.2 but i can't connect to hive.

If you have any solution for this issue , i will appreciate.

Thanks.
Employee

Re: [resolved] hive-site.xml not found on CLASSPATH

Hello,
You don't need to put a Hive site in the classpath. Actually, at runtime, Hive requires this file to be in the classpath but it's not mandatory. All the needed properties are overriden by the Talend components.
What is your error/problem? It's gonna be helpful to help you.
Rémy.
One Star

Re: [resolved] hive-site.xml not found on CLASSPATH

Hi all,
did you find the solution? i get the same error message!
thanks.
One Star

Re: [resolved] hive-site.xml not found on CLASSPATH

I am also getting the same error..Is there any solution for this?
13/10/29 12:14:10 WARN conf.HiveConf: hive-site.xml not found on CLASSPATH
13/10/29 12:14:11 INFO metastore.HiveMetaStore: 0: Opening raw store with implemenation classSmiley Surprisedrg.apache.hadoop.hive.metastore.ObjectStore
13/10/29 12:14:11 INFO metastore.ObjectStore: ObjectStore, initialize called
13/10/29 12:14:11 INFO DataNucleus.Persistence: Property datanucleus.cache.level2 unknown - will be ignored
13/10/29 12:14:11 INFO DataNucleus.Persistence: Property javax.jdo.option.NonTransactionalRead unknown - will be ignored
13/10/29 12:14:11 INFO DataNucleus.Persistence: ================= Persistence Configuration ===============
13/10/29 12:14:11 INFO DataNucleus.Persistence: DataNucleus Persistence Factory - Vendor: "DataNucleus" Version: "2.0.3"
13/10/29 12:14:11 INFO DataNucleus.Persistence: DataNucleus Persistence Factory initialised for datastore URL="jdbc:derby:;databaseName=metastore_db;create=true" driver="org.apache.derby.jdbc.EmbeddedDriver" userName="APP"
13/10/29 12:14:11 INFO DataNucleus.Persistence: ===========================================================
13/10/29 12:14:12 INFO Datastore.Schema: Initialising Catalog "", Schema "APP" using "None" auto-start option
etc....
Employee

Re: [resolved] hive-site.xml not found on CLASSPATH

Hi,
It is just a warning. It's not an error and this missing file doesn't matter. Everything is supposed to be set up in the generated code. If you have an error, please attach the real problem.
Cheers,
Rémy.
One Star

Re: [resolved] hive-site.xml not found on CLASSPATH

Sending the complete error message..
13/10/29 12:14:10 WARN conf.HiveConf: hive-site.xml not found on CLASSPATH
13/10/29 12:14:11 INFO metastore.HiveMetaStore: 0: Opening raw store with implemenation classSmiley Surprisedrg.apache.hadoop.hive.metastore.ObjectStore
13/10/29 12:14:11 INFO metastore.ObjectStore: ObjectStore, initialize called
13/10/29 12:14:11 INFO DataNucleus.Persistence: Property datanucleus.cache.level2 unknown - will be ignored
13/10/29 12:14:11 INFO DataNucleus.Persistence: Property javax.jdo.option.NonTransactionalRead unknown - will be ignored
13/10/29 12:14:11 INFO DataNucleus.Persistence: ================= Persistence Configuration ===============
13/10/29 12:14:11 INFO DataNucleus.Persistence: DataNucleus Persistence Factory - Vendor: "DataNucleus" Version: "2.0.3"
13/10/29 12:14:11 INFO DataNucleus.Persistence: DataNucleus Persistence Factory initialised for datastore URL="jdbc:derby:;databaseName=metastore_db;create=true" driver="org.apache.derby.jdbc.EmbeddedDriver" userName="APP"
13/10/29 12:14:11 INFO DataNucleus.Persistence: ===========================================================
13/10/29 12:14:12 INFO Datastore.Schema: Initialising Catalog "", Schema "APP" using "None" auto-start option
13/10/29 12:14:12 INFO Datastore.Schema: Catalog "", Schema "APP" initialised - managing 0 classes
13/10/29 12:14:12 INFO metastore.ObjectStore: Setting MetaStore object pin classes with hive.metastore.cache.pinobjtypes="Table,StorageDescriptor,SerDeInfo,Partition,Database,Type,FieldSchema,Order"
13/10/29 12:14:12 INFO DataNucleus.MetaData: Registering listener for metadata initialisation
13/10/29 12:14:12 INFO metastore.ObjectStore: Initialized ObjectStore
13/10/29 12:14:12 WARN DataNucleus.MetaData: MetaData Parser encountered an error in file "jar:file:/D:/Talend/TOS_BD-r104014-V5.3.1/workspace/.Java/lib/hive-metastore-0.8.1.jar!/package.jdo" at line 11, column 6 : cvc-elt.1: Cannot find the declaration of element 'jdo'. - Please check your specification of DTD and the validity of the MetaData XML that you have specified.
13/10/29 12:14:12 WARN DataNucleus.MetaData: MetaData Parser encountered an error in file "jar:file:/D:/Talend/TOS_BD-r104014-V5.3.1/workspace/.Java/lib/hive-metastore-0.8.1.jar!/package.jdo" at line 321, column 13 : The content of element type "class" must match "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreign-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)". - Please check your specification of DTD and the validity of the MetaData XML that you have specified.
13/10/29 12:14:12 WARN DataNucleus.MetaData: MetaData Parser encountered an error in file "jar:file:/D:/Talend/TOS_BD-r104014-V5.3.1/workspace/.Java/lib/hive-metastore-0.8.1.jar!/package.jdo" at line 368, column 13 : The content of element type "class" must match "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreign-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)". - Please check your specification of DTD and the validity of the MetaData XML that you have specified.
13/10/29 12:14:13 WARN DataNucleus.MetaData: MetaData Parser encountered an error in file "jar:file:/D:/Talend/TOS_BD-r104014-V5.3.1/workspace/.Java/lib/hive-metastore-0.8.1.jar!/package.jdo" at line 390, column 13 : The content of element type "class" must match "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreign-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)". - Please check your specification of DTD and the validity of the MetaData XML that you have specified.
13/10/29 12:14:13 WARN DataNucleus.MetaData: MetaData Parser encountered an error in file "jar:file:/D:/Talend/TOS_BD-r104014-V5.3.1/workspace/.Java/lib/hive-metastore-0.8.1.jar!/package.jdo" at line 425, column 13 : The content of element type "class" must match "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreign-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)". - Please check your specification of DTD and the validity of the MetaData XML that you have specified.
13/10/29 12:14:13 WARN DataNucleus.MetaData: MetaData Parser encountered an error in file "jar:file:/D:/Talend/TOS_BD-r104014-V5.3.1/workspace/.Java/lib/hive-metastore-0.8.1.jar!/package.jdo" at line 462, column 13 : The content of element type "class" must match "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreign-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)". - Please check your specification of DTD and the validity of the MetaData XML that you have specified.
13/10/29 12:14:13 WARN DataNucleus.MetaData: MetaData Parser encountered an error in file "jar:file:/D:/Talend/TOS_BD-r104014-V5.3.1/workspace/.Java/lib/hive-metastore-0.8.1.jar!/package.jdo" at line 503, column 13 : The content of element type "class" must match "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreign-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)". - Please check your specification of DTD and the validity of the MetaData XML that you have specified.
13/10/29 12:14:13 WARN DataNucleus.MetaData: MetaData Parser encountered an error in file "jar:file:/D:/Talend/TOS_BD-r104014-V5.3.1/workspace/.Java/lib/hive-metastore-0.8.1.jar!/package.jdo" at line 544, column 13 : The content of element type "class" must match "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreign-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)". - Please check your specification of DTD and the validity of the MetaData XML that you have specified.
13/10/29 12:14:13 WARN DataNucleus.MetaData: MetaData Parser encountered an error in file "jar:file:/D:/Talend/TOS_BD-r104014-V5.3.1/workspace/.Java/lib/hive-metastore-0.8.1.jar!/package.jdo" at line 585, column 13 : The content of element type "class" must match "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreign-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)". - Please check your specification of DTD and the validity of the MetaData XML that you have specified.
13/10/29 12:14:13 WARN DataNucleus.MetaData: MetaData Parser encountered an error in file "jar:file:/D:/Talend/TOS_BD-r104014-V5.3.1/workspace/.Java/lib/hive-metastore-0.8.1.jar!/package.jdo" at line 630, column 13 : The content of element type "class" must match "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreign-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)". - Please check your specification of DTD and the validity of the MetaData XML that you have specified.
13/10/29 12:14:13 WARN DataNucleus.MetaData: MetaData Parser encountered an error in file "jar:file:/D:/Talend/TOS_BD-r104014-V5.3.1/workspace/.Java/lib/hive-metastore-0.8.1.jar!/package.jdo" at line 675, column 13 : The content of element type "class" must match "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreign-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)". - Please check your specification of DTD and the validity of the MetaData XML that you have specified.
13/10/29 12:14:13 WARN DataNucleus.MetaData: MetaData Parser encountered an error in file "jar:file:/D:/Talend/TOS_BD-r104014-V5.3.1/workspace/.Java/lib/hive-metastore-0.8.1.jar!/package.jdo" at line 703, column 13 : The content of element type "class" must match "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreign-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)". - Please check your specification of DTD and the validity of the MetaData XML that you have specified.
13/10/29 12:14:14 INFO DataNucleus.Persistence: Managing Persistence of Class : org.apache.hadoop.hive.metastore.model.MDatabase
13/10/29 12:14:14 INFO DataNucleus.Persistence: Managing Persistence of Field : org.apache.hadoop.hive.metastore.model.MDatabase.parameters
13/10/29 12:14:14 INFO Datastore.Schema: Validating 2 unique key(s) for table DBS
13/10/29 12:14:14 INFO Datastore.Schema: Validating 0 foreign key(s) for table DBS
13/10/29 12:14:14 INFO Datastore.Schema: Validating 2 index(es) for table DBS
13/10/29 12:14:14 INFO Datastore.Schema: Validating 1 unique key(s) for table DATABASE_PARAMS
13/10/29 12:14:14 INFO Datastore.Schema: Validating 1 foreign key(s) for table DATABASE_PARAMS
13/10/29 12:14:14 INFO Datastore.Schema: Validating 2 index(es) for table DATABASE_PARAMS
==========================
13/10/29 12:14:14 INFO DataNucleus.MetaData: Listener found initialisation for persistable class org.apache.hadoop.hive.metastore.model.MDatabase
Unable to create log directory /tmp/hadoop
==========================
13/10/29 12:14:14 ERROR exec.HiveHistory: Unable to create log directory /tmp/hadoop
Exception in component tHiveConnection_1
java.lang.RuntimeException: java.io.IOException: The system cannot find the path specified
at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:265)
at org.apache.hadoop.hive.service.HiveServer$HiveServerHandler.(HiveServer.java:136)
at org.apache.hadoop.hive.service.HiveServer$HiveServerHandler.(HiveServer.java:121)
at org.apache.hadoop.hive.jdbc.HiveConnection.(HiveConnection.java:76)
at org.apache.hadoop.hive.jdbc.HiveDriver.connect(HiveDriver.java:104)
at java.sql.DriverManager.getConnection(Unknown Source)
at java.sql.DriverManager.getConnection(Unknown Source)
at test_bd.hive_connect_0_1.Hive_connect.tHiveConnection_1Process(Hive_connect.java:324)
at test_bd.hive_connect_0_1.Hive_connect.runJobInTOS(Hive_connect.java:1074)
at test_bd.hive_connect_0_1.Hive_connect.main(Hive_connect.java:940)
Caused by: java.io.IOException: The system cannot find the path specified
at java.io.WinNTFileSystem.createFileExclusively(Native Method)
at java.io.File.checkAndCreate(Unknown Source)
at java.io.File.createTempFile(Unknown Source)
at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:261)
... 9 more
disconnected
Job Hive_connect ended at 12:14 29/10/2013.
Employee

Re: [resolved] hive-site.xml not found on CLASSPATH

Hi,
It seems the folder /tmp doesn?t exist in HDFS.
Can you please confirm using:
- hadoop fs -ls /
If you confirm, please create the directory and set up the correct permissions:
- su hdfs
- hadoop fs -mkdir /tmp
- hadoop fs -chmod -R 777 /tmp
One Star

Re: [resolved] hive-site.xml not found on CLASSPATH

The error message still exists after changing the folder permission.
Here is the ls result..

:/usr/local/hadoop$ hadoop fs -ls /
Warning: $HADOOP_HOME is deprecated.
Found 5 items
drwxr-xr-x - ciber supergroup 0 2013-09-25 18:02 /app
drwxr-xr-x - ciber supergroup 0 2013-10-28 20:09 /home
drwxr-xr-x - ciber supergroup 0 2013-09-27 17:58 /system
drwxrwxrwx - ciber supergroup 0 2013-10-30 20:56 /tmp
drwxr-xr-x - ciber supergroup 0 2013-10-28 20:18 /user
Employee

Re: [resolved] hive-site.xml not found on CLASSPATH

Hi,
Is your studio located on Windows? If this is the case, could you please confirm you have a "tmp" folder created in C:/ ?
Cheers,
Rémy.
One Star

Re: [resolved] hive-site.xml not found on CLASSPATH

Hi Remy,
I am getting the same error after creating a folder /tmp/hadoop under "C" drive..Here is the error..

Starting job Hive_connect at 14:26 05/11/2013.

connecting to socket on port 3743
connected
13/11/05 14:26:02 WARN conf.HiveConf: hive-site.xml not found on CLASSPATH
13/11/05 14:26:02 INFO metastore.HiveMetaStore: 0: Opening raw store with implemenation classSmiley Surprisedrg.apache.hadoop.hive.metastore.ObjectStore
13/11/05 14:26:02 INFO metastore.ObjectStore: ObjectStore, initialize called
13/11/05 14:26:03 INFO DataNucleus.Persistence: Property datanucleus.cache.level2 unknown - will be ignored
13/11/05 14:26:03 INFO DataNucleus.Persistence: Property javax.jdo.option.NonTransactionalRead unknown - will be ignored
13/11/05 14:26:03 INFO DataNucleus.Persistence: ================= Persistence Configuration ===============
13/11/05 14:26:03 INFO DataNucleus.Persistence: DataNucleus Persistence Factory - Vendor: "DataNucleus" Version: "2.0.3"
13/11/05 14:26:03 INFO DataNucleus.Persistence: DataNucleus Persistence Factory initialised for datastore URL="jdbc:derby:;databaseName=metastore_db;create=true" driver="org.apache.derby.jdbc.EmbeddedDriver" userName="APP"
13/11/05 14:26:03 INFO DataNucleus.Persistence: ===========================================================
13/11/05 14:26:04 INFO Datastore.Schema: Initialising Catalog "", Schema "APP" using "None" auto-start option
13/11/05 14:26:04 INFO Datastore.Schema: Catalog "", Schema "APP" initialised - managing 0 classes
13/11/05 14:26:04 INFO metastore.ObjectStore: Setting MetaStore object pin classes with hive.metastore.cache.pinobjtypes="Table,StorageDescriptor,SerDeInfo,Partition,Database,Type,FieldSchema,Order"
13/11/05 14:26:04 INFO DataNucleus.MetaData: Registering listener for metadata initialisation
13/11/05 14:26:04 INFO metastore.ObjectStore: Initialized ObjectStore
13/11/05 14:26:04 WARN DataNucleus.MetaData: MetaData Parser encountered an error in file "jar:file:/D:/Talend/TOS_BD-r104014-V5.3.1/workspace/.Java/lib/hive-metastore-0.8.1.jar!/package.jdo" at line 11, column 6 : cvc-elt.1: Cannot find the declaration of element 'jdo'. - Please check your specification of DTD and the validity of the MetaData XML that you have specified.
13/11/05 14:26:04 WARN DataNucleus.MetaData: MetaData Parser encountered an error in file "jar:file:/D:/Talend/TOS_BD-r104014-V5.3.1/workspace/.Java/lib/hive-metastore-0.8.1.jar!/package.jdo" at line 321, column 13 : The content of element type "class" must match "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreign-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)". - Please check your specification of DTD and the validity of the MetaData XML that you have specified.
13/11/05 14:26:04 WARN DataNucleus.MetaData: MetaData Parser encountered an error in file "jar:file:/D:/Talend/TOS_BD-r104014-V5.3.1/workspace/.Java/lib/hive-metastore-0.8.1.jar!/package.jdo" at line 368, column 13 : The content of element type "class" must match "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreign-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)". - Please check your specification of DTD and the validity of the MetaData XML that you have specified.
13/11/05 14:26:04 WARN DataNucleus.MetaData: MetaData Parser encountered an error in file "jar:file:/D:/Talend/TOS_BD-r104014-V5.3.1/workspace/.Java/lib/hive-metastore-0.8.1.jar!/package.jdo" at line 390, column 13 : The content of element type "class" must match "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreign-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)". - Please check your specification of DTD and the validity of the MetaData XML that you have specified.
13/11/05 14:26:04 WARN DataNucleus.MetaData: MetaData Parser encountered an error in file "jar:file:/D:/Talend/TOS_BD-r104014-V5.3.1/workspace/.Java/lib/hive-metastore-0.8.1.jar!/package.jdo" at line 425, column 13 : The content of element type "class" must match "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreign-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)". - Please check your specification of DTD and the validity of the MetaData XML that you have specified.
13/11/05 14:26:04 WARN DataNucleus.MetaData: MetaData Parser encountered an error in file "jar:file:/D:/Talend/TOS_BD-r104014-V5.3.1/workspace/.Java/lib/hive-metastore-0.8.1.jar!/package.jdo" at line 462, column 13 : The content of element type "class" must match "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreign-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)". - Please check your specification of DTD and the validity of the MetaData XML that you have specified.
13/11/05 14:26:05 WARN DataNucleus.MetaData: MetaData Parser encountered an error in file "jar:file:/D:/Talend/TOS_BD-r104014-V5.3.1/workspace/.Java/lib/hive-metastore-0.8.1.jar!/package.jdo" at line 503, column 13 : The content of element type "class" must match "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreign-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)". - Please check your specification of DTD and the validity of the MetaData XML that you have specified.
13/11/05 14:26:05 WARN DataNucleus.MetaData: MetaData Parser encountered an error in file "jar:file:/D:/Talend/TOS_BD-r104014-V5.3.1/workspace/.Java/lib/hive-metastore-0.8.1.jar!/package.jdo" at line 544, column 13 : The content of element type "class" must match "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreign-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)". - Please check your specification of DTD and the validity of the MetaData XML that you have specified.
13/11/05 14:26:05 WARN DataNucleus.MetaData: MetaData Parser encountered an error in file "jar:file:/D:/Talend/TOS_BD-r104014-V5.3.1/workspace/.Java/lib/hive-metastore-0.8.1.jar!/package.jdo" at line 585, column 13 : The content of element type "class" must match "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreign-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)". - Please check your specification of DTD and the validity of the MetaData XML that you have specified.
13/11/05 14:26:05 WARN DataNucleus.MetaData: MetaData Parser encountered an error in file "jar:file:/D:/Talend/TOS_BD-r104014-V5.3.1/workspace/.Java/lib/hive-metastore-0.8.1.jar!/package.jdo" at line 630, column 13 : The content of element type "class" must match "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreign-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)". - Please check your specification of DTD and the validity of the MetaData XML that you have specified.
13/11/05 14:26:05 WARN DataNucleus.MetaData: MetaData Parser encountered an error in file "jar:file:/D:/Talend/TOS_BD-r104014-V5.3.1/workspace/.Java/lib/hive-metastore-0.8.1.jar!/package.jdo" at line 675, column 13 : The content of element type "class" must match "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreign-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)". - Please check your specification of DTD and the validity of the MetaData XML that you have specified.
13/11/05 14:26:05 WARN DataNucleus.MetaData: MetaData Parser encountered an error in file "jar:file:/D:/Talend/TOS_BD-r104014-V5.3.1/workspace/.Java/lib/hive-metastore-0.8.1.jar!/package.jdo" at line 703, column 13 : The content of element type "class" must match "(extension*,implements*,datastore-identity?,primary-key?,inheritance?,version?,join*,foreign-key*,index*,unique*,column*,field*,property*,query*,fetch-group*,extension*)". - Please check your specification of DTD and the validity of the MetaData XML that you have specified.
13/11/05 14:26:05 INFO DataNucleus.Persistence: Managing Persistence of Class : org.apache.hadoop.hive.metastore.model.MDatabase
13/11/05 14:26:05 INFO DataNucleus.Persistence: Managing Persistence of Field : org.apache.hadoop.hive.metastore.model.MDatabase.parameters
13/11/05 14:26:05 INFO Datastore.Schema: Validating 2 unique key(s) for table DBS
13/11/05 14:26:05 INFO Datastore.Schema: Validating 0 foreign key(s) for table DBS
13/11/05 14:26:05 INFO Datastore.Schema: Validating 2 index(es) for table DBS
13/11/05 14:26:05 INFO Datastore.Schema: Validating 1 unique key(s) for table DATABASE_PARAMS
13/11/05 14:26:05 INFO Datastore.Schema: Validating 1 foreign key(s) for table DATABASE_PARAMS
13/11/05 14:26:05 INFO Datastore.Schema: Validating 2 index(es) for table DATABASE_PARAMS
13/11/05 14:26:05 INFO DataNucleus.MetaData: Listener found initialisation for persistable class org.apache.hadoop.hive.metastore.model.MDatabase
Unable to create log directory /tmp/hadoop
13/11/05 14:26:06 ERROR exec.HiveHistory: Unable to create log directory /tmp/hadoop
Exception in component tHiveConnection_1
java.lang.RuntimeException: java.io.IOException: The system cannot find the path specified
at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:265)
at org.apache.hadoop.hive.service.HiveServer$HiveServerHandler.(HiveServer.java:136)
at org.apache.hadoop.hive.service.HiveServer$HiveServerHandler.(HiveServer.java:121)
at org.apache.hadoop.hive.jdbc.HiveConnection.(HiveConnection.java:76)
at org.apache.hadoop.hive.jdbc.HiveDriver.connect(HiveDriver.java:104)
at java.sql.DriverManager.getConnection(Unknown Source)
at java.sql.DriverManager.getConnection(Unknown Source)
at test_bd.hive_connect_0_1.Hive_connect.tHiveConnection_1Process(Hive_connect.java:324)
at test_bd.hive_connect_0_1.Hive_connect.runJobInTOS(Hive_connect.java:1074)
at test_bd.hive_connect_0_1.Hive_connect.main(Hive_connect.java:940)
Caused by: java.io.IOException: The system cannot find the path specified
at java.io.WinNTFileSystem.createFileExclusively(Native Method)
at java.io.File.checkAndCreate(Unknown Source)
at java.io.File.createTempFile(Unknown Source)
at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:261)
... 9 more
disconnected
Job Hive_connect ended at 14:26 05/11/2013.
Employee

Re: [resolved] hive-site.xml not found on CLASSPATH

What's your hadoop distribution?
One Star

Re: [resolved] hive-site.xml not found on CLASSPATH

I am using Apache stack.
Employee

Re: [resolved] hive-site.xml not found on CLASSPATH

What did you select as the distribution in the talend component?
One Star

Re: [resolved] hive-site.xml not found on CLASSPATH

As i showed my screenshot, i had selected "Apache" as distribution and Hive version as "Apache 1.0.0 (Hive 0.9.0).
One Star

Re: [resolved] hive-site.xml not found on CLASSPATH

Could you please confirm the "Connection Mode"? As of now, i am using "Embedded" mode.
Employee

Re: [resolved] hive-site.xml not found on CLASSPATH

Hi,
Embedded is good. Nevertheless, it would be gret you to confirm that the metastore is started on the port 9083.
What is the output of the command (to be launched on the namenode machine): netstat -ntlup | grep :9083
One Star

Re: [resolved] hive-site.xml not found on CLASSPATH

Finally i found the solution for this issue. Though it is very simple, i took a long time to find out.
1. Please make sure about port -> it should be 10000 for standalone mode
2. Start Hive Thrift Server by entering "hive --service hiveserver"
Also check in http://raj-hadoop.blogspot.in/2013/11/talend-open-studio-warn-confhiveconf.html
Thats it! you can play around Talend now!
Employee

Re: [resolved] hive-site.xml not found on CLASSPATH

Standalone = 10000
Embedded = 9083
There are default ports. Need to make sure this is the same for your clusters.
One Star

Re: [resolved] hive-site.xml not found on CLASSPATH

Even you set your port correctly, you need to start hive thrift server by sending "hive --service hiveserver" to connect hive from remote.