Unhandled event loop exception when i am uploading large excel file

Four Stars

Unhandled event loop exception when i am uploading large excel file

AS suggested i have changed the TOS_DI-win-x86_64 file values as below

-vmargs
-Xms4096m
-Xmx8192m

 

i have tried 1024/2048 , 2048/4096 , 4096/8192 but still i am getting the same problem

 

Logs i am getting from below location

C:\talend\TOS_DI-Win32-20170510_1410-V6.4.0\workspace\.metadata


!ENTRY org.eclipse.ui 4 0 2017-06-14 12:27:08.104
!MESSAGE Unhandled event loop exception
!STACK 0
java.lang.OutOfMemoryError: Java heap space
at org.apache.xmlbeans.impl.store.Cur.createElementXobj(Cur.java:257)
at org.apache.xmlbeans.impl.store.Cur$CurLoadContext.startElement(Cur.java:2992)
at org.apache.xmlbeans.impl.store.Locale.loadNode(Locale.java:1413)
at org.apache.xmlbeans.impl.store.Locale.loadNodeChildren(Locale.java:1396)
at org.apache.xmlbeans.impl.store.Locale.loadNode(Locale.java:1438)
at org.apache.xmlbeans.impl.store.Locale.loadNodeChildren(Locale.java:1396)
at org.apache.xmlbeans.impl.store.Locale.loadNode(Locale.java:1438)
at org.apache.xmlbeans.impl.store.Locale.loadNodeChildren(Locale.java:1396)
at org.apache.xmlbeans.impl.store.Locale.loadNode(Locale.java:1438)
at org.apache.xmlbeans.impl.store.Locale.loadNodeChildren(Locale.java:1396)
at org.apache.xmlbeans.impl.store.Locale.loadNode(Locale.java:1438)
at org.apache.xmlbeans.impl.store.Locale.parseToXmlObject(Locale.java:1378)
at org.apache.xmlbeans.impl.store.Locale.parseToXmlObject(Locale.java:1363)
at org.apache.xmlbeans.impl.schema.SchemaTypeLoaderBase.parse(SchemaTypeLoaderBase.java:370)
at org.apache.poi.POIXMLTypeLoader.parse(POIXMLTypeLoader.java:144)
at org.openxmlformats.schemas.spreadsheetml.x2006.main.WorksheetDocument$Factory.parse(Unknown Source)
at org.apache.poi.xssf.usermodel.XSSFSheet.read(XSSFSheet.java:183)
at org.apache.poi.xssf.usermodel.XSSFSheet.onDocumentRead(XSSFSheet.java:175)
at org.apache.poi.xssf.usermodel.XSSFWorkbook.parseSheet(XSSFWorkbook.java:438)
at org.apache.poi.xssf.usermodel.XSSFWorkbook.onDocumentRead(XSSFWorkbook.java:403)
at org.apache.poi.POIXMLDocument.load(POIXMLDocument.java:190)
at org.apache.poi.xssf.usermodel.XSSFWorkbook.<init>(XSSFWorkbook.java:266)
at org.talend.repository.ui.wizards.metadata.connection.files.excel.ExcelReader.init(ExcelReader.java:144)
at org.talend.repository.ui.wizards.metadata.connection.files.excel.ExcelReader.<init>(ExcelReader.java:93)
at org.talend.repository.ui.wizards.metadata.connection.files.excel.ExcelFileStep1Form.viewExcelFile(ExcelFileStep1Form.java:629)
at org.talend.repository.ui.wizards.metadata.connection.files.excel.ExcelFileStep1Form.access$5(ExcelFileStep1Form.java:604)
at org.talend.repository.ui.wizards.metadata.connection.files.excel.ExcelFileStep1Form$7.modifyText(ExcelFileStep1Form.java:481)
at org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:179)
at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84)
at org.eclipse.swt.widgets.Display.sendEvent(Display.java:4353)
at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1061)
at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1085)

Sixteen Stars

Re: Unhandled event loop exception when i am uploading large excel file

It's not the JVM settings for the Studio you need to worry about so much here, it is the JVM settings for the job. This will show yo where you need to set these (http://garpitmzn.blogspot.co.uk/2013/08/talend-modify-jvm-arguments-for-job.html). By the way, there is no need to set the Xms to such a high value. The Xms is the initial memory allocation pool. This is meant to grow. Upping this will just immediately reserve that memory instead of letting it grow as it is needed.

Four Stars

Re: Unhandled event loop exception when i am uploading large excel file

Hi I have changed the VM argument value as -Xms1024M and -Xmx2048M but still i was getting the same problem.

 

Four Stars

Re: Unhandled event loop exception when i am uploading large excel file

Hi I have changed the VM argument value as -Xms1024M and -Xmx2048M but still i was getting the same problem.
Sixteen Stars

Re: Unhandled event loop exception when i am uploading large excel file

So you have changed the VM arguments as per the link I posted and ticked the "Use specific JVM arguments" on the "Advanced settings" tab on the "Run" tab of the job? You are running the job from the Studio, right?

 

If the answer is yes to the above, then how big is your Excel file?

Four Stars

Re: Unhandled event loop exception when i am uploading large excel file

Like i am getting this error when i am uploading excel . Excel has more than 50000 rows.
I think VM argument will work if we are running any job.
But here i am not running the job i am getting this exception when i am creating excel file in Talend.
Sixteen Stars

Re: Unhandled event loop exception when i am uploading large excel file

Ah I see, so when you are creating the metadata?

 

Sorry, I misunderstood. It sounds like a bug. If the file is not that big I would recommend manually creating the metadata for it (build the schema manually) and use that. Are you using the open source edition or the enterprise edition and what version? If you have a support contract, I would raise this.

Four Stars

Re: Unhandled event loop exception when i am uploading large excel file

Yes i am creating the file manually only. I am selecting the excel right click from there i am browsing the excel file.
i am using free version of Talend

Talend Open Studio for Data Integration
Version: 6.4.0
Sixteen Stars

Re: Unhandled event loop exception when i am uploading large excel file

@shong@xdshi have you seen this?


Moderator

Re: Unhandled event loop exception when i am uploading large excel file

Hello,

Does this issue only occur when you upload a large excel? Is it Ok with you when upload a simple excel? Could you try to use V 6.3 to see if this issue repro?

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
Four Stars

Re: Unhandled event loop exception when i am uploading large excel file

Yes this issue is only occurring when i am uploading large excel file.

I have not try with the v 6.3.
If you have any solution for this problem please let me know as we are doing the POC for our migration. This issue creating problem for us.
Moderator

Re: Unhandled event loop exception when i am uploading large excel file

Hi,

About your "Unhandled event loop exception" issue when create a big excel file in metadata, please create a jira issue on talend bug tracker.

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
Four Stars

Re: Unhandled event loop exception when i am uploading large excel file

Hi,

 

I have exactly the same issue, and I wanted to know if that problem was solved or not ?

My excel file is around 46000 rows...

 

Regards

Flo

Moderator

Re: Unhandled event loop exception when i am uploading large excel file

Hello Flo,

Have you already tried to changed the VM argument value in your studio to see if it works for you?

Please have a look at my screenshot.

1.png

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
Four Stars

Re: Unhandled event loop exception when i am uploading large excel file

Hi Sabrina,

 

I did it and I put the same option in the .ini files.

I also realisde that I forgot to change to the "event mode" instead of "User mode" and that's solve the problem.

 

Thanks for your help Smiley Happy

Cheers

Florian

Moderator

Re: Unhandled event loop exception when i am uploading large excel file

Hello Florian,

Thanks for your prompt reply.

Hope this article about:https://community.talend.com/t5/Migration-Configuration-and/OutOfMemory-Exception/ta-p/21669/jump-to... will be helpful for you.

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.