My current pipeline consists of tS3_Connection --> tS3_Get --> tFileInputDelimited --> tMap. When I run the job, the data is successfully pulled from my S3 bucket and stored in a local file on my computer; however, when I try to use tFileInputDelimited to pull the data into tMap for transformation, it is all empty. Do I need to use a different component for this process? I've checked all of my settings and they appear to be in order.
@SAI_Chief ,what type of file is it ?
@SAI_Chief ,have you defined,schema in the tFileInputDelimitted? i think you have not defined
It is a csv file. Is there a way to define the schema without having to manually type in all of the column names? Especially with csv files with 40-50 columns?
@SAI_Chief ,if your using Licensed Talend ,you can try with Dynamic data type. If your using Open stiudio,you need to define schema.
Talend named a Leader.
Kickstart your first data integration and ETL projects.
Watch the recorded webinar!
Part 2 of a series on Context Variables
Learn how to do cool things with Context Variables
Find out how to migrate from one database to another using the Dynamic schema