Loading FlatFiles

Four Stars

Loading FlatFiles

Hi, Please I am trying to load a FlatFile from a local drive using ( tFileInputDelimited to a tBigQueryOutPutBulk), But The number of rows transferred is lesser than the number in the input file

 

Fl.PNGBasic flow

 

 

the data is separated with ; (semicolon) and the Text qualifier is "", example of a row will be like "16711";"20160101";"Oct 28 2017  9:32AM"  

The Input is using this Definition is as below

ISC.PNG

 

Below is the component setting

 

Cnt.PNG

 

The only thing I read on the talend help page is that if any of the columns is non nullable then , the row will be removed if null, but in my schema definition I made sure all the columns is nullable for the InputFile and the tBigQueryOutPutBulk, Please can anyone advice or point to anywhere I can check. I am using the open studio and new to talend. Thanks


Accepted Solutions
Fifteen Stars TRF
Fifteen Stars

Re: Loading FlatFiles

Hi,
Any message on the console?
Are sure all the records match with the schema defined for the input file?

TRF
Four Stars

Re: Loading FlatFiles

Thanks , it had to do with the schema, some of the values of the incoming data do not match, that was why it was omitting the row, I made everything into string and it passed. for the time


All Replies
Fifteen Stars TRF
Fifteen Stars

Re: Loading FlatFiles

Hi,
Any message on the console?
Are sure all the records match with the schema defined for the input file?

TRF
Four Stars

Re: Loading FlatFiles

Thanks , it had to do with the schema, some of the values of the incoming data do not match, that was why it was omitting the row, I made everything into string and it passed. for the time

Fifteen Stars TRF
Fifteen Stars

Re: Loading FlatFiles

Don't forget to mark your case as solved.

Kudos also accepted!


TRF

What’s New for Talend Spring ’19

Watch the recorded webinar!

Watch Now

Tutorial

Introduction to Talend Open Studio for Data Integration.

Watch

Downloads and Trials

Test drive Talend's enterprise products.

Downloads

Definitive Guide to Data Integration

Practical steps to developing your data integration strategy.

Download