additional column in schema of tMSSqlOutputBulkExec

Seven Stars

additional column in schema of tMSSqlOutputBulkExec

Hello,

 

I am fetching some millions of rows from MySql and loading it into SQL server using bulk insert (tMSSqlOutputBulkExec) component. 

 

The issue is in edit schema I can add only those columns which are in the source(input) I cannot add any additional column in target side schema if I do that I get below error

 

tMSSqlOutputBulkExec_7_tMBE Bulk load data conversion error (type mismatch or invalid character for the specified codepage) for row 1, column 1 (<name of new column>)

 

I even tried to insert that new column first in SQL server directly and then keeping the same schema in component still it fails with above error.

 

Can anyone please help.

 

 

 

Talend Data Fabric 6.3.1

Java 8 


Accepted Solutions
Employee

Re: additional column in schema of tMSSqlOutputBulkExec

Hi,

 

      If you add a tmap, you will be able to customize the list of columns required in output flow. 

 

      If you are having 5 input columns and you would like to have 6 columns in the output, then you should use the tmap to map between source and target columns.

 

      The best way to learn tmap is to practice the scenarios mentioned in the tmap.

 

https://help.talend.com/reader/wDRBNUuxk629sNcI0dNYaA/mxzKD~8eLuNFSXH6LMi7qg

 

Warm Regards,

 

Nikhil Thampi

 

View solution in original post


All Replies
Seven Stars

Re: additional column in schema of tMSSqlOutputBulkExec

Out of curiosity, have you tried to add the new column with a tMap in the middle or straight on the Output component?

Employee

Re: additional column in schema of tMSSqlOutputBulkExec

Hi,

 

    Could you please share a screen shot of the job you are creating so that we will get more idea about it?

 

Warm Regards,

 

Nikhil Thampi

Seven Stars

Re: additional column in schema of tMSSqlOutputBulkExec

No tMap direct row(main) connection between tAmazonMySqlInput and tMSSqlOutputBulkExec. Can we solve this problem using tMap, if yes then how?

Employee

Re: additional column in schema of tMSSqlOutputBulkExec

Hi,

 

      If you add a tmap, you will be able to customize the list of columns required in output flow. 

 

      If you are having 5 input columns and you would like to have 6 columns in the output, then you should use the tmap to map between source and target columns.

 

      The best way to learn tmap is to practice the scenarios mentioned in the tmap.

 

https://help.talend.com/reader/wDRBNUuxk629sNcI0dNYaA/mxzKD~8eLuNFSXH6LMi7qg

 

Warm Regards,

 

Nikhil Thampi

 

View solution in original post

Seven Stars

Re: additional column in schema of tMSSqlOutputBulkExec

Thank you @nikhilthampi adding tmap solved the issue.

Employee

Re: additional column in schema of tMSSqlOutputBulkExec

Happy to help you.

 

Enjoy Talend :-)

 

Warm Regards,

 

Nikhil Thampi

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Best Practices for Using Context Variables with Talend – Part 2

Part 2 of a series on Context Variables

Blog

Best Practices for Using Context Variables with Talend – Part 1

Learn how to do cool things with Context Variables

Blog

Migrate Data from one Database to another with one Job using the Dynamic Schema

Find out how to migrate from one database to another using the Dynamic schema

Blog