tFileExcel component error when using tFileArchive in the same job since migrating to TOS 7.2.1

Highlighted
Four Stars

tFileExcel component error when using tFileArchive in the same job since migrating to TOS 7.2.1

Hello Guys,

 

Since I've upgrade TOS 7.1.1 to 7.2.1, i have a error in All Job containing tFileInputExcel and tFileArchive in the same Job.

 

I've got this error on tFileInputExcel component :

 

Exception in component tFileInputExcel_2 (Test)

java.lang.IllegalArgumentException: InputStream of class class org.apache.commons.compress.archivers.zip.ZipFile$1 is not implementing InputStreamStatistics.

at org.apache.poi.openxml4j.util.ZipArchiveThresholdInputStream.<init>(ZipArchiveThresholdInputStream.java:64)

at org.apache.poi.openxml4j.util.ZipSecureFile.getInputStream(ZipSecureFile.java:147)

at org.apache.poi.openxml4j.util.ZipSecureFile.getInputStream(ZipSecureFile.java:34)

at org.apache.poi.openxml4j.util.ZipFileZipEntrySource.getInputStream(ZipFileZipEntrySource.java:66)

at org.apache.poi.openxml4j.opc.ZipPackage.getPartsImpl(ZipPackage.java:260)

at org.apache.poi.openxml4j.opc.OPCPackage.getParts(OPCPackage.java:726)

at org.apache.poi.openxml4j.opc.OPCPackage.open(OPCPackage.java:237)

at org.apache.poi.openxml4j.opc.OPCPackage.open(OPCPackage.java:166)

at org.apache.poi.ooxml.POIXMLDocument.openPackage(POIXMLDocument.java:89)

at org.apache.poi.xssf.usermodel.XSSFWorkbook.<init>(XSSFWorkbook.java:336)

at asm_import.test_0_1.Test.tFileInputExcel_2Process(Test.java:805)

at asm_import.test_0_1.Test.runJobInTOS(Test.java:1728)

at asm_import.test_0_1.Test.main(Test.java:1553)

 

Just by removing the tFileArchive component of the job, so all work fine without error.

 

I've trying to test a Job with only tFileInputExcel -> tLogRow. It work fine.
I've trying to test a Job with only tFileArchive. It work fine too.


Finaly, I've testing a Job with one tFileInputExcel -> tLogRow and tFileArchive and then I've got this error !

In TOS 7.1.1 all the jobs works fine.

 

I've testing all this case on a another computer with same environnement, and I've the same isssue.

Is someone can help me to resolve this troubleshooting ?

 

Thank you for yor help.

Eric

-----------------------

Environnement context :
- MacOS Mojave 10.14.6
- TOS 7.2.1,
- Java : jdk1.8.0_221

Highlighted
Moderator

Re: tFileExcel component error when using tFileArchive in the same job since migrating to TOS 7.2.1

Hello,

Have you tried to use "OnsubjobOK" instead of "OnComponentOk" trigger to see if this job works?

Your tFileArchive subjob starts only when the previous subjob completely finishes.

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
Highlighted
Four Stars

Re: tFileExcel component error when using tFileArchive in the same job since migrating to TOS 7.2.1

Thank you Sabrina for your help,

This is a Job developed with TOS 7.1 and witch works perfectly.

After importing it into TOS 7.2, all Jobs containing an Excel tFileInput and a tFile Archive crash at compilation. Before you even start.

I have several Job whose tFileArchive is at the end of Job linked by an OnSubJobOk and all of them are crashing.


The error concerns tFile InputExcel and when I delete the tFileArchive from the job then everything works perfectly.

It seems that there is an incompatibility between these two versions of components

Bests regards

Eric.
Highlighted
Four Stars

Re: tFileExcel component error when using tFileArchive in the same job since migrating to TOS 7.2.1

Hi Eric, 

 

Did you ever get this issue resolved? 

Highlighted
Four Stars

Re: tFileExcel component error when using tFileArchive in the same job since migrating to TOS 7.2.1

Hi,

I have the same problem in TOS 7.2.1

Try also in TOS 7.3.1 M1, same problem there...

I try in a simple job, just take a tFileArchive and after a OnSubJobOk a tFileInputExcel and you have the crash !

2019-09-19 10_59_10-Talend Open Studio for Data Integration (7.3.1.20190827_1309-M1) _ RVL_INTERFACE.png

 

https://jira.talendforge.org/browse/TDI-42979
Highlighted
Five Stars

Re: tFileExcel component error when using tFileArchive in the same job since migrating to TOS 7.2.1

I have had a similar issue with a job created in 6.5.2 and migrated to 7.2.1.

It uses a tFileInputExcel component that fails with the exact same error message, we do not have any archiving components in the job.

The job is a sub-job when executed on its own it works fine, if called from its parent job then I get the same error as you.

 

The fix for us is to create a new sub job and copy in the components from the original sub-job and hey presto, it works!

 

Highlighted
Four Stars

Re: tFileExcel component error when using tFileArchive in the same job since migrating to TOS 7.2.1

Hi,

There is a workaround given by talend :

  1. Download commons-compress Jar from official maven repo - https://mvnrepository.com/artifact/org.apache.commons/commons-compress/1.19
  2. Open Window / Show View / Modules (Talend).
  3. Search in tab: commons-compress
  4. Perform changes to tFileArchive: click on [...] - > chose for Module File - downloaded jar - > Check Custom mvn uri - provide unique URI (e.g. - mvnSmiley Surprisedrg.talend.libraries/commons-compress-1.19/6.1.0/jar) - > Detect the module install status -> Ok.
  5. Perform changes on tFileInputExcel: Click on [...] - > Check Custom mvn uri - provide unique URI from step 4 - > Detect the module install status -> Ok.
Highlighted
Four Stars

Re: tFileExcel component error when using tFileArchive in the same job since migrating to TOS 7.2.1

Hi, 

 

I have the same issue and I have to separate into 2 independent processes as follows and It works perfectly. 

It is recommended to check on "Use an independent process to run subjob" of tFileUnarchive.

 

Talend UnarchiveFile.png

 

Regards, 

 

Thu Le

2019 GARTNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

Best Practices for Using Context Variables with Talend – Part 2

Part 2 of a series on Context Variables

Blog

Best Practices for Using Context Variables with Talend – Part 1

Learn how to do cool things with Context Variables

Blog

Migrate Data from one Database to another with one Job using the Dynamic Schema

Find out how to migrate from one database to another using the Dynamic schema

Blog