how to filter the column data using Tmap or using any other component.?

Highlighted
Six Stars

how to filter the column data using Tmap or using any other component.?

how to filter the column data using Tmap or using any other  component.?

Please find the attached sample screen shot.

 

 How to  filter the column which is having InstanceID inside the dimension column. filter the InstabceID based in  ID available .

eg: InstanceID  = 1ccc219a-db2f-4877-87e0-f19cd8d31420  ---> one file

      InstanceId = e339090a-0c18-49de-993f-0c8c3fc57721  ---> to another file.

 


Accepted Solutions
Employee

Re: how to filter the column data using Tmap or using any other component.?

Hi,

 

    Please refer the below job flow for results.

image.png

 

The component screenshots are as below.image.pnginput excel read

 

image.pngJson extract

 

image.pngremove empty rows

 

image.pngtFlowtoIterate

 

image.pngtrowgenerate

 

image.pngoutput in separate files

 

Please refer the output files below.

 

image.pngimage.pngimage.png

 

 

Could you please mark the topic as resolved since solution has been provided? Kudos are also welcome :-)

 

Warm Regards,

 

Nikhil Thampi


Warm Regards,
Nikhil Thampi
Please appreciate our members by giving Kudos for spending their time for your query. If your query is answered, please mark the topic as resolved :-)

All Replies
Employee

Re: how to filter the column data using Tmap or using any other component.?

Hi,

 

     The data in that column is in JSON format. Please use tExtractJSONFields component to extract the data to separate columns. Once the data is available for instance ID in separate column, you can filter using expression column in tMap for downstream activities.

 

     Please refer the below link for details about component.

 

https://help.talend.com/reader/mjoDghHoMPI0yuyZ83a13Q/LcNrhqdlyheCLpwyUwgJQw

 

    If the answer has helped you, could you please mark the topic as resolved? Kudos are also welcome :-)

 

Warm Regards,

 

Nikhil Thampi


Warm Regards,
Nikhil Thampi
Please appreciate our members by giving Kudos for spending their time for your query. If your query is answered, please mark the topic as resolved :-)
Six Stars

Re: how to filter the column data using Tmap or using any other component.?

As i m using Talend open source . The dimension column will be keep on changing every time, the columns inside the dimension its not constant. So i have kept it in single column.

 

after converting the json to csv file these are the columns data has.

 

I need to filter the dimension column which is having InstanceID based on the ID.

Employee

Re: how to filter the column data using Tmap or using any other component.?

Hi,

 

    Could you please provide the sample data in a csv file and file share it to Talend community?

 

    It is very difficult to setup and data from screen shots. 

 

Warm Regards,

 

Nikhil Thampi


Warm Regards,
Nikhil Thampi
Please appreciate our members by giving Kudos for spending their time for your query. If your query is answered, please mark the topic as resolved :-)
Six Stars

Re: how to filter the column data using Tmap or using any other component.?

Could you please share ur mail ID. so can send u the sample file to ur mail.

Employee

Re: how to filter the column data using Tmap or using any other component.?

Hi,

 

     Please post it in community as attachment after removing confidential details. The aim of the community is that everyone can learn together. So if the attachment is available in community, it will help everyone to learn :-)

 

Warm Regards,

 

Nikhil Thampi


Warm Regards,
Nikhil Thampi
Please appreciate our members by giving Kudos for spending their time for your query. If your query is answered, please mark the topic as resolved :-)
Six Stars

Re: how to filter the column data using Tmap or using any other component.?

Please find the attached sample file for ur reference. We need to filter the column based on InstanceID.

Employee

Re: how to filter the column data using Tmap or using any other component.?

Hi,

 

    Please refer the below job flow for results.

image.png

 

The component screenshots are as below.image.pnginput excel read

 

image.pngJson extract

 

image.pngremove empty rows

 

image.pngtFlowtoIterate

 

image.pngtrowgenerate

 

image.pngoutput in separate files

 

Please refer the output files below.

 

image.pngimage.pngimage.png

 

 

Could you please mark the topic as resolved since solution has been provided? Kudos are also welcome :-)

 

Warm Regards,

 

Nikhil Thampi


Warm Regards,
Nikhil Thampi
Please appreciate our members by giving Kudos for spending their time for your query. If your query is answered, please mark the topic as resolved :-)
Six Stars

Re: how to filter the column data using Tmap or using any other component.?

Thank you so much for the solution. I ll implement it in my job. If  get any doubt i will reply back.

Six Stars

Re: how to filter the column data using Tmap or using any other component.?

Hi Nikhil,

 

I have one more requirement . I have to split the columns which are inside the column,

I have attached the file. Please let me know how to split property column furthur.

 

  

Cloud Free Trial

Try Talend Cloud free for 30 days.

Tutorial

Introduction to Talend Open Studio for Data Integration.

Definitive Guide to Data Integration

Practical steps to developing your data integration strategy.

Definitive Guide to Data Quality

Create systems and workflow to manage clean data ingestion and data transformation.