Talend Studio Metadata Excel: Unhandled event loop exception and java.lang.OutOfMemoryError

Five Stars

Talend Studio Metadata Excel: Unhandled event loop exception and java.lang.OutOfMemoryError

Hi Guys,

I am trying to create excel metadata of 3.5 GB Excel file in Talend Studio 7.0.1. My Laptop is workstation of 32 GB Ram & powerfull processor. I already have set the TOS_DI-win-x86_64.ini file with huge amount of memory but still it is not working.

-vmargs
-Xms512m
-Xmx25536m
-Dfile.encoding=UTF-8
-Dosgi.requiredJavaVersion=1.8
-XX:+UseG1GC
-XX:+UseStringDeduplication
-Dsun.net.client.defaultReadTimeout=600000

I am getting following exception

Message- Unhandled event loop exception
Exception Stake Trace-
java.lang.OutOfMemoryError
	at java.io.ByteArrayOutputStream.hugeCapacity(Unknown Source)
	at java.io.ByteArrayOutputStream.grow(Unknown Source)
	at java.io.ByteArrayOutputStream.ensureCapacity(Unknown Source)
	at java.io.ByteArrayOutputStream.write(Unknown Source)
	at org.apache.poi.openxml4j.util.ZipInputStreamZipEntrySource$FakeZipEntry.<init>(ZipInputStreamZipEntrySource.java:133)
	at org.apache.poi.openxml4j.util.ZipInputStreamZipEntrySource.<init>(ZipInputStreamZipEntrySource.java:56)
	at org.apache.poi.openxml4j.opc.ZipPackage.<init>(ZipPackage.java:100)
	at org.apache.poi.openxml4j.opc.OPCPackage.open(OPCPackage.java:324)
	at org.talend.repository.ui.wizards.metadata.connection.files.excel.ExcelReader.init(ExcelReader.java:120)
	at org.talend.repository.ui.wizards.metadata.connection.files.excel.ExcelReader.<init>(ExcelReader.java:97)
	at org.talend.repository.ui.wizards.metadata.connection.files.excel.ExcelFileStep1Form.viewExcelFile(ExcelFileStep1Form.java:629)
	at org.talend.repository.ui.wizards.metadata.connection.files.excel.ExcelFileStep1Form.access$5(ExcelFileStep1Form.java:604)
	at org.talend.repository.ui.wizards.metadata.connection.files.excel.ExcelFileStep1Form$7.modifyText(ExcelFileStep1Form.java:481)
	at org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:179)
	at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84)
	at org.eclipse.swt.widgets.Display.sendEvent(Display.java:4353)
	at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1061)
	at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1085)
	at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1066)
	at org.eclipse.swt.widgets.Text.wmCommandChild(Text.java:2987)
	at org.eclipse.swt.widgets.Control.WM_COMMAND(Control.java:4751)
	at org.eclipse.swt.widgets.Control.windowProc(Control.java:4613)
	at org.eclipse.swt.widgets.Display.windowProc(Display.java:5023)
	at org.eclipse.swt.internal.win32.OS.CallWindowProcW(Native Method)
	at org.eclipse.swt.internal.win32.OS.CallWindowProc(OS.java:2443)
	at org.eclipse.swt.widgets.Text.callWindowProc(Text.java:260)
	at org.eclipse.swt.widgets.Control.windowProc(Control.java:4705)
	at org.eclipse.swt.widgets.Text.windowProc(Text.java:2610)
	at org.eclipse.swt.widgets.Display.windowProc(Display.java:5023)
	at org.eclipse.swt.internal.win32.OS.SetWindowTextW(Native Method)
	at org.eclipse.swt.internal.win32.OS.SetWindowText(OS.java:3473)
	at org.eclipse.swt.widgets.Text.setText(Text.java:2260)
	at org.talend.commons.ui.swt.formtools.LabelledFileField.setFileFieldValue(LabelledFileField.java:231)
	at org.talend.commons.ui.swt.formtools.LabelledFileField.displayDialog(LabelledFileField.java:226)
	at org.talend.commons.ui.swt.formtools.LabelledFileField$2.widgetSelected(LabelledFileField.java:192)
	at org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:248)
	at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84)
	at org.eclipse.swt.widgets.Display.sendEvent(Display.java:4353)
	at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1061)
	at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4172)
	at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3761)
	at org.eclipse.jface.window.Window.runEventLoop(Window.java:832)
	at org.eclipse.jface.window.Window.open(Window.java:808)
	at org.talend.repository.metadata.ui.actions.metadata.CreateFileExcelAction.doRun(CreateFileExcelAction.java:102)
	at org.talend.repository.ui.actions.AContextualAction$2.run(AContextualAction.java:633)
	at org.talend.repository.RepositoryWorkUnit.executeRun(RepositoryWorkUnit.java:99)
	at org.talend.core.repository.model.AbstractRepositoryFactory.executeRepositoryWorkUnit(AbstractRepositoryFactory.java:258)
	at org.talend.repository.localprovider.model.LocalRepositoryFactory.executeRepositoryWorkUnit(LocalRepositoryFactory.java:3420)
	at org.talend.core.repository.model.ProxyRepositoryFactory.executeRepositoryWorkUnit(ProxyRepositoryFactory.java:2247)
	at org.talend.repository.ui.actions.AContextualAction.run(AContextualAction.java:639)
	at org.eclipse.jface.action.Action.runWithEvent(Action.java:519)
	at org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:595)
	at org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:511)
	at org.eclipse.jface.action.ActionContributionItem$5.handleEvent(ActionContributionItem.java:420)
	at org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84)
	at org.eclipse.swt.widgets.Display.sendEvent(Display.java:4353)
	at org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1061)
	at org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4172)
	at org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3761)
	at org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine$9.run(PartRenderingEngine.java:1151)
	at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332)
	at org.eclipse.e4.ui.internal.workbench.swt.PartRenderingEngine.run(PartRenderingEngine.java:1032)
	at org.eclipse.e4.ui.internal.workbench.E4Workbench.createAndRunUI(E4Workbench.java:148)
	at org.eclipse.ui.internal.Workbench$5.run(Workbench.java:636)
	at org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332)
	at org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:579)
	at org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:150)
	at org.talend.rcp.intro.Application.start(Application.java:265)
	at org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196)
	at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:134)
	at org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:104)
	at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:380)
	at org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:235)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(Unknown Source)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
	at java.lang.reflect.Method.invoke(Unknown Source)
	at org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:648)
	at org.eclipse.equinox.launcher.Main.basicRun(Main.java:603)
	at org.eclipse.equinox.launcher.Main.run(Main.java:1465)
Session Data-
eclipse.buildId=unknown
java.version=1.8.0_181
java.vendor=Oracle Corporation
BootLoader constants: OS=win32, ARCH=x86_64, WS=win32, NL=en_US
Command-line arguments:  -os win32 -ws win32 -arch x86_64

Any help would be appriciated !! 

 

Thanks and Best Regards

Hitesh Mundra

Community Manager

Re: Talend Studio Metadata Excel: Unhandled event loop exception and java.lang.OutOfMemoryError

The only way you will do this is to get the metadata from a scaled down version of the file. 3.5GB is a MASSIVE Excel file.

Five Stars

Re: Talend Studio Metadata Excel: Unhandled event loop exception and java.lang.OutOfMemoryError

Yes, but I can't open even in Excel. How can I break such file ?

Community Manager

Re: Talend Studio Metadata Excel: Unhandled event loop exception and java.lang.OutOfMemoryError

How was it created? If you cannot open it in Excel, your chances with anything else are minimal

Five Stars

Re: Talend Studio Metadata Excel: Unhandled event loop exception and java.lang.OutOfMemoryError

This file is created by some other team via Teamcenter tool. May be some kind of SQL command like EXPORT INTO filename
Community Manager

Re: Talend Studio Metadata Excel: Unhandled event loop exception and java.lang.OutOfMemoryError

If the file cannot be opened by Excel which has one job (to work with Excel files), it is highly unlikely that anything else will be able to open it. Of course, I do not know of every piece of software out there that can open Excel. You are far better off seeing if you can get the data put into a flat file. 

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Best Practices for Using Context Variables with Talend – Part 1

Learn how to do cool things with Context Variables

Blog

Migrate Data from one Database to another with one Job using the Dynamic Schema

Find out how to migrate from one database to another using the Dynamic schema

Blog

Best Practices for Using Context Variables with Talend – Part 4

Pick up some tips and tricks with Context Variables

Blog