i have a table which looks like this
ID Product Sale 1 A1 40 2 A2 30 .. n An 50
i want to use Talend job to create a pivot table like this:
ID A1 A2 .. An 1 40 null null 2 null 30 null n null null 50
my Talend Job looks like this:
Tmssql_input ==> Tdenomalized ==>TextractedDemilitedFields==> Tmssql_ouput.
(i learn it from this Post: https://community.talend.com/t5/Design-and-Development/resolved-Pivot-Table-with-multiple-rows/td-p/...)
The Problem with the Job is whenever there is a new Product, i need to modify the Schema of TextractedDemilitedFields with new Product-column manually.
therefore i want to change the Job to make it dynamic. the Job should automatic pivot the new Product when it comes.
i can't use tpivottocolumndelimited because my data has 1 billion records and this tpivot components works very slowly
Can you please help me with this Issue?
Talend named a Leader.
Kickstart your first data integration and ETL projects.
Part 2 of a series on Context Variables
Learn how to do cool things with Context Variables
Find out how to migrate from one database to another using the Dynamic schema