Talend Cloud 7.1 - Issue when using Dynamic Schema with CSV file

Highlighted
Four Stars

Talend Cloud 7.1 - Issue when using Dynamic Schema with CSV file

Hello Community, 

I'm reading a csv file Dynamically but it seems that this data structure is deleting the first row (The mot important one in my case)

enter image description here

enter image description here

You can see that my file contains 109 row but the tFileInput seems to read 108.

Same file, with same configuration and changing Dynamic to String is working perfectly.

enter image description here

 

I need to read the file dynamically because columns number is variable and is I need to pivot my file according to the first missing line (Header of my file).

Any Idea ? Thank you Smiley Happy

Moderator

Re: Talend Cloud 7.1 - Issue when using Dynamic Schema with CSV file

Hello,

Are you able to upload your screenshots by clicking the "photos"? Let us know if there is any problem when you upload your screenshots on community.

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
Six Stars

Re: Talend Cloud 7.1 - Issue when using Dynamic Schema with CSV file

Hi,

 

As far as I know you always need to have a header row when using Dynamic schema's, Talend determines the dynamic schema (and also column names I guess) using this header.

 

Kind regards,

 

Michael

Nine Stars

Re: Talend Cloud 7.1 - Issue when using Dynamic Schema with CSV file

Hi,

 

Also, don't forget that when reading data in from a dynamic schema, it wont know what the column types are, only how many there are - they will all be treated as strings - so nulls for numbers and dates will become things like 0 and 1900-01-01.

 

 

Regards David
Dont forget to give Kudos when an answer is helpful or mark the answer as the solution.

2019 GARTNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

Best Practices for Using Context Variables with Talend – Part 1

Learn how to do cool things with Context Variables

Blog

Migrate Data from one Database to another with one Job using the Dynamic Schema

Find out how to migrate from one database to another using the Dynamic schema

Blog

Best Practices for Using Context Variables with Talend – Part 4

Pick up some tips and tricks with Context Variables

Blog