One Star

[resolved] tMDMBulkLoad Error - Exception in component tMDMBulkLoad_1

Hello,
My organisation is palnning to use Talend MDM tool suite and for that I installed MDM tool set and doing a demo.
I have installed and working with Talend MDM, also enjoied working MDM_DEMo project.
Now I have created a Data Container, Data Model, Entity and View in Studio. When I am logging in to Web UI then I can see my Entity/table there. Now when I try to load data into that entity, I am getting below error,
Exception in component tMDMBulkLoad_1
java.io.IOException: An exception occurred while processing last record.
at org.talend.mdm.bulkload.client.InputStreamMerger.throwLastFailure(InputStreamMerger.java:191)
at org.talend.mdm.bulkload.client.InputStreamMerger.close(InputStreamMerger.java:262)
at mdm_demo.load_uom_to_mdm_1_0_1.Load_UOM_To_MDM_1.tWriteXMLField_1_InProcess(Load_UOM_To_MDM_1.java:1400)
at mdm_demo.load_uom_to_mdm_1_0_1.Load_UOM_To_MDM_1$1ThreadXMLField_tWriteXMLField_1_Out.run(Load_UOM_To_MDM_1.java:698)
Caused by: org.talend.mdm.bulkload.client.BulkloadException: An exception happened during bulk load on MDM server.
javax.servlet.ServletException: javax.servlet.ServletException: java.lang.NullPointerException
at com.amalto.core.servlet.TransactionFilter.doFilter(TransactionFilter.java:41)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.amalto.core.servlet.ErrorFilter.doFilter(ErrorFilter.java:33)
disconnected
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at org.jboss.web.tomcat.filters.ReplyHeaderFilter.doFilter(ReplyHeaderFilter.java:96)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:230)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:175)
at org.jboss.web.tomcat.security.SecurityAssociationValve.invoke(SecurityAssociationValve.java:179)
at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:524)
at org.jboss.web.tomcat.security.JaccContextValve.invoke(JaccContextValve.java:84)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
at org.jboss.web.tomcat.service.jca.CachedConnectionValve.invoke(CachedConnectionValve.java:157)
at org.apache.catalina.authenticator.SingleSignOn.invoke(SingleSignOn.java:393)
at org.apache.catalina.authenticator.MDMSingleSignOn.invoke(MDMSingleSignOn.java:73)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:262)
at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:844)
at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:583)
at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:446)
at java.lang.Thread.run(Unknown Source)
Caused by: javax.servlet.ServletException: java.lang.NullPointerException
at com.amalto.core.servlet.LoadServlet.doPut(LoadServlet.java:111)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:713)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:803)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.amalto.core.servlet.TransactionFilter.doFilter(TransactionFilter.java:38)
... 24 more
Caused by: java.lang.NullPointerException
at com.amalto.core.servlet.LoadServlet.getTypeKey(LoadServlet.java:173)
at com.amalto.core.servlet.LoadServlet.doPut(LoadServlet.java:108)
... 29 more
at org.talend.mdm.bulkload.client.BulkloadClientUtil.bulkload(BulkloadClientUtil.java:77)
at org.talend.mdm.bulkload.client.BulkloadClientUtil$AsyncLoadRunnable.run(BulkloadClientUtil.java:167)
at java.lang.Thread.run(Unknown Source)
Can you please guide on whats going wrong ??

Please see attachments for further details
14 REPLIES
One Star

Re: [resolved] tMDMBulkLoad Error - Exception in component tMDMBulkLoad_1

Please see attachments..
One Star

Re: [resolved] tMDMBulkLoad Error - Exception in component tMDMBulkLoad_1

further attachments
One Star

Re: [resolved] tMDMBulkLoad Error - Exception in component tMDMBulkLoad_1

Model and Entity Details..
One Star

Re: [resolved] tMDMBulkLoad Error - Exception in component tMDMBulkLoad_1

Model and Entity Details..
One Star

Re: [resolved] tMDMBulkLoad Error - Exception in component tMDMBulkLoad_1

model
Community Manager

Re: [resolved] tMDMBulkLoad Error - Exception in component tMDMBulkLoad_1

Hi
Please note that it is case sensitive on the element name, I see the first element is 'ID' in the entity, however, it is 'Id' in the XML tree. Also, is the ID element defined as AUTO-INCRESMENT property in the entity? If so, remove Id column from the XML tree and check 'Generate ID' box on tMDMBulkLoad component.
Shong
----------------------------------------------------------
Talend | Data Agility for Modern Business
One Star

Re: [resolved] tMDMBulkLoad Error - Exception in component tMDMBulkLoad_1

thanks Shong.
Actually now I have changed Id to Id and made sure that XML Tree names match with Element Names.
Also, the ID field is not system generated and I have a column called ROW_ID coming from database which is a
system generated key I want to use for ID of entity Unit_Of_Measure. But still I am facing below problem
Starting job Copy_of_Load_UOM_To_MDM at 11:04 26/02/2014.
connecting to socket on port 3432
connected
Exception in component tMDMBulkLoad_1
java.io.IOException: An exception occurred while processing last record.
at org.talend.mdm.bulkload.client.InputStreamMerger.throwLastFailure(InputStreamMerger.java:191)
at org.talend.mdm.bulkload.client.InputStreamMerger.close(InputStreamMerger.java:262)
at mdm_demo.copy_of_load_uom_to_mdm_0_1.Copy_of_Load_UOM_To_MDM.tWriteXMLField_1_InProcess(Copy_of_Load_UOM_To_MDM.java:1779)
at mdm_demo.copy_of_load_uom_to_mdm_0_1.Copy_of_Load_UOM_To_MDM$1ThreadXMLField_tWriteXMLField_1_Out.run(Copy_of_Load_UOM_To_MDM.java:1001)
Caused by: org.talend.mdm.bulkload.client.BulkloadException: An exception happened during bulk load on MDM server.
javax.servlet.ServletException: javax.servlet.ServletException: java.lang.NullPointerException
at com.amalto.core.servlet.TransactionFilter.doFilter(TransactionFilter.java:41)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
disconnected
at com.amalto.core.servlet.ErrorFilter.doFilter(ErrorFilter.java:33)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at org.jboss.web.tomcat.filters.ReplyHeaderFilter.doFilter(ReplyHeaderFilter.java:96)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:230)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:175)
at org.jboss.web.tomcat.security.SecurityAssociationValve.invoke(SecurityAssociationValve.java:179)
at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:524)
at org.jboss.web.tomcat.security.JaccContextValve.invoke(JaccContextValve.java:84)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
at org.jboss.web.tomcat.service.jca.CachedConnectionValve.invoke(CachedConnectionValve.java:157)
at org.apache.catalina.authenticator.SingleSignOn.invoke(SingleSignOn.java:393)
at org.apache.catalina.authenticator.MDMSingleSignOn.invoke(MDMSingleSignOn.java:73)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:262)
at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:844)
at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:583)
at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:446)
at java.lang.Thread.run(Unknown Source)
Caused by: javax.servlet.ServletException: java.lang.NullPointerException
at com.amalto.core.servlet.LoadServlet.doPut(LoadServlet.java:111)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:713)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:803)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.amalto.core.servlet.TransactionFilter.doFilter(TransactionFilter.java:38)
... 24 more
Caused by: java.lang.NullPointerException
at com.amalto.core.servlet.LoadServlet.getTypeKey(LoadServlet.java:173)
at com.amalto.core.servlet.LoadServlet.doPut(LoadServlet.java:108)
... 29 more
at org.talend.mdm.bulkload.client.BulkloadClientUtil.bulkload(BulkloadClientUtil.java:77)
at org.talend.mdm.bulkload.client.BulkloadClientUtil$AsyncLoadRunnable.run(BulkloadClientUtil.java:167)
at java.lang.Thread.run(Unknown Source)
Job Copy_of_Load_UOM_To_MDM ended at 11:04 26/02/2014.
I will email you further details.
We are a customer of Talend and my organisation recently bought enterprise version/licensed version of Talend.
So Better I email you all details.
thanks
Community Manager

Re: [resolved] tMDMBulkLoad Error - Exception in component tMDMBulkLoad_1

Hi
Which version of Talend Studio are you using?
Try to set the first element ID as loop element on tWriteXMLField. In addition, can you check if there exist null or empty value in ID column after tOracleInput component? To debug it, just need to add a tLogRow after tOracleInput to print the result on the console.
Shong
----------------------------------------------------------
Talend | Data Agility for Modern Business
One Star

Re: [resolved] tMDMBulkLoad Error - Exception in component tMDMBulkLoad_1

Hello Shong,
I am using Talend Open Studio for MDM (5.4.1r111943).
I have changed loop element to Id.
I dont think that there are null or empty value as I changed my query for test to extract 1 record only with below where condition
Where
ROW_ID=20

this query is working and extracting 1 record with ROW_ID as 20, but still job is failing.
Starting job Copy_of_Load_UOM_To_MDM at 14:49 27/02/2014.
connecting to socket on port 3993
connected
Exception in component tMDMBulkLoad_1
java.io.IOException: An exception occurred while processing last record.
at org.talend.mdm.bulkload.client.InputStreamMerger.throwLastFailure(InputStreamMerger.java:191)
at org.talend.mdm.bulkload.client.InputStreamMerger.close(InputStreamMerger.java:262)
at mdm_demo.copy_of_load_uom_to_mdm_0_1.Copy_of_Load_UOM_To_MDM.tWriteXMLField_1_InProcess(Copy_of_Load_UOM_To_MDM.java:1780)
at mdm_demo.copy_of_load_uom_to_mdm_0_1.Copy_of_Load_UOM_To_MDM$1ThreadXMLField_tWriteXMLField_1_Out.run(Copy_of_Load_UOM_To_MDM.java:1001)
Caused by: org.talend.mdm.bulkload.client.BulkloadException: An exception happened during bulk load on MDM server.
javax.servlet.ServletException: javax.servlet.ServletException: java.lang.NullPointerException
at com.amalto.core.servlet.TransactionFilter.doFilter(TransactionFilter.java:41)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
disconnected
at com.amalto.core.servlet.ErrorFilter.doFilter(ErrorFilter.java:33)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at org.jboss.web.tomcat.filters.ReplyHeaderFilter.doFilter(ReplyHeaderFilter.java:96)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:235)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at org.apache.catalina.core.StandardWrapperValve.invoke(StandardWrapperValve.java:230)
at org.apache.catalina.core.StandardContextValve.invoke(StandardContextValve.java:175)
at org.jboss.web.tomcat.security.SecurityAssociationValve.invoke(SecurityAssociationValve.java:179)
at org.apache.catalina.authenticator.AuthenticatorBase.invoke(AuthenticatorBase.java:524)
at org.jboss.web.tomcat.security.JaccContextValve.invoke(JaccContextValve.java:84)
at org.apache.catalina.core.StandardHostValve.invoke(StandardHostValve.java:127)
at org.apache.catalina.valves.ErrorReportValve.invoke(ErrorReportValve.java:102)
at org.jboss.web.tomcat.service.jca.CachedConnectionValve.invoke(CachedConnectionValve.java:157)
at org.apache.catalina.authenticator.SingleSignOn.invoke(SingleSignOn.java:393)
at org.apache.catalina.authenticator.MDMSingleSignOn.invoke(MDMSingleSignOn.java:73)
at org.apache.catalina.core.StandardEngineValve.invoke(StandardEngineValve.java:109)
at org.apache.catalina.connector.CoyoteAdapter.service(CoyoteAdapter.java:262)
at org.apache.coyote.http11.Http11Processor.process(Http11Processor.java:844)
at org.apache.coyote.http11.Http11Protocol$Http11ConnectionHandler.process(Http11Protocol.java:583)
at org.apache.tomcat.util.net.JIoEndpoint$Worker.run(JIoEndpoint.java:446)
at java.lang.Thread.run(Unknown Source)
Caused by: javax.servlet.ServletException: java.lang.NullPointerException
at com.amalto.core.servlet.LoadServlet.doPut(LoadServlet.java:111)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:713)
at javax.servlet.http.HttpServlet.service(HttpServlet.java:803)
at org.apache.catalina.core.ApplicationFilterChain.internalDoFilter(ApplicationFilterChain.java:290)
at org.apache.catalina.core.ApplicationFilterChain.doFilter(ApplicationFilterChain.java:206)
at com.amalto.core.servlet.TransactionFilter.doFilter(TransactionFilter.java:38)
... 24 more
Caused by: java.lang.NullPointerException
at com.amalto.core.servlet.LoadServlet.getTypeKey(LoadServlet.java:173)
at com.amalto.core.servlet.LoadServlet.doPut(LoadServlet.java:108)
... 29 more
at org.talend.mdm.bulkload.client.BulkloadClientUtil.bulkload(BulkloadClientUtil.java:77)
at org.talend.mdm.bulkload.client.BulkloadClientUtil$AsyncLoadRunnable.run(BulkloadClientUtil.java:167)
at java.lang.Thread.run(Unknown Source)
Job Copy_of_Load_UOM_To_MDM ended at 14:50 27/02/2014.

I created another job with manually entering data in tFixedFlowInput component and providing that component to tMDMBulkLoad but still that job also failing. Please see screnshots...does something wrong with my model ??
One Star

Re: [resolved] tMDMBulkLoad Error - Exception in component tMDMBulkLoad_1

my data model screenshot and actual data model export.
One Star

Re: [resolved] tMDMBulkLoad Error - Exception in component tMDMBulkLoad_1

@
Community Manager

Re: [resolved] tMDMBulkLoad Error - Exception in component tMDMBulkLoad_1

Hi
Do you use RDBMS or XML DB as the MDM hub database? From your screenshot, I see the model name and the container name are different, if RDBMS, the model name and the container name should be the same.
Shong
----------------------------------------------------------
Talend | Data Agility for Modern Business
One Star

Re: [resolved] tMDMBulkLoad Error - Exception in component tMDMBulkLoad_1

Hmn...thanks Shong....I am using XML DB as MDM hub database.
I was not knowing that the container name and model name need to be same.
I changed my data model name same as container name and ...bang...its WORKING !!!
the job is working. thanks alot for your help...appriciated...
Community Manager

Re: [resolved] tMDMBulkLoad Error - Exception in component tMDMBulkLoad_1

Great! Glad to see you resolve the problem and thanks for your feedback.
Shong
----------------------------------------------------------
Talend | Data Agility for Modern Business