Inserting number of columns into several csv files based upon the values in count column of input csv file

Four Stars

Inserting number of columns into several csv files based upon the values in count column of input csv file

Hello community,

 

I have a csv file which consists of several columns. There is also a column called count having values like 1,2,3,5, etc. specific to each record. Now at the output, there would be multiple csv files and the number of columns at each of the csv file would depend upon the values of 'count' column. Consider the below scenario for further details.

input csv -

id;name;sal;count
1;abc;100;2
2;def;200;1
3;ghi;400;3

 

output csv -

(Taking 1st row into consideration)

 

As the value of 'count' here is 2 therefore, output csv will have 

id;name
1;abc
2;def
3;ghi

ie., only the first 2 columns.

 

Please help me achieve this scenario.

 

Thanks in advance!

 

Best Regards,

Dipanjan

 

Highlighted
Thirteen Stars

Re: Inserting number of columns into several csv files based upon the values in count column of input csv file

@dipanjan93,if i understand correctly, you just want to take the first two columns of the input file is that correct?

 

you can just filter the columns which you do not want to populate using tFilterColumns or tJavarow or tMap.

Manohar B
Four Stars

Re: Inserting number of columns into several csv files based upon the values in count column of input csv file

@manodwhb Well not really. Number of columns at the output csv file would be dependent upon the 'count'. As in the example you can see for the 1st record count is 2 therefore 2 columns are there at the output. Similarly, for the second row the value of count column is 1 so the output shall have 1 columns. So on and so forth.

Tutorial

Introduction to Talend Open Studio for Data Integration.

Definitive Guide to Data Integration

Practical steps to developing your data integration strategy.

Definitive Guide to Data Quality

Create systems and workflow to manage clean data ingestion and data transformation.