Numeric field getting converted to string for dynamic datatype for csv file

Highlighted
Four Stars

Numeric field getting converted to string for dynamic datatype for csv file

Hi All,

I have a talend job which reads from  a .csv file and writes to a greenplum table using the "dynamic column" feature of Talend Enterprise Edition. Its a simple one to one mapping job.

The table structure is already defined and a few numeric/date fields are present. 

 

Problem is dynamic data type is reading all fields as string and job is erroring out saying Column is of type numeric but expression is of string.

 

Can anyone help me in modifying the settings for dynamic datatype to detect numeric and date fields automatically.

 

Regards,

Rashmitha.B

Seven Stars

Re: Numeric field getting converted to string for dynamic datatype for csv file

Yes, Dynamic schema reads all fields String data type you need to transform the data(using TMAP) before you send it to your target.

Thanks,
Sid
Please like the post if it is useful
Please put to resolved if it resolves your issue.
Thanks,
Sid
Mark as solution if this resolved your issue
Four Stars

Re: Numeric field getting converted to string for dynamic datatype for csv file

Thanks for your reply.

 

The reason why we chose Dynamic datatype was because we do not know the column names and their datatypes. The same job has to run for multiple files. 

 

Can you give me an example of how  to convert in tmap? I have only one column of datatype Dynamic.

Capture.JPG

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Best Practices for Using Context Variables with Talend – Part 2

Part 2 of a series on Context Variables

Blog

Best Practices for Using Context Variables with Talend – Part 1

Learn how to do cool things with Context Variables

Blog

Migrate Data from one Database to another with one Job using the Dynamic Schema

Find out how to migrate from one database to another using the Dynamic schema

Blog