how to filter the column data using Tmap or using any other component.?

Six Stars

how to filter the column data using Tmap or using any other component.?

how to filter the column data using Tmap or using any other  component.?

Please find the attached sample screen shot.

 

 How to  filter the column which is having InstanceID inside the dimension column. filter the InstabceID based in  ID available .

eg: InstanceID  = 1ccc219a-db2f-4877-87e0-f19cd8d31420  ---> one file

      InstanceId = e339090a-0c18-49de-993f-0c8c3fc57721  ---> to another file.

 


Accepted Solutions
Employee

Re: how to filter the column data using Tmap or using any other component.?

Hi,

 

    Please refer the below job flow for results.

image.png

 

The component screenshots are as below.image.pnginput excel read

 

image.pngJson extract

 

image.pngremove empty rows

 

image.pngtFlowtoIterate

 

image.pngtrowgenerate

 

image.pngoutput in separate files

 

Please refer the output files below.

 

image.pngimage.pngimage.png

 

 

Could you please mark the topic as resolved since solution has been provided? Kudos are also welcome :-)

 

Warm Regards,

 

Nikhil Thampi


All Replies
Employee

Re: how to filter the column data using Tmap or using any other component.?

Hi,

 

     The data in that column is in JSON format. Please use tExtractJSONFields component to extract the data to separate columns. Once the data is available for instance ID in separate column, you can filter using expression column in tMap for downstream activities.

 

     Please refer the below link for details about component.

 

https://help.talend.com/reader/mjoDghHoMPI0yuyZ83a13Q/LcNrhqdlyheCLpwyUwgJQw

 

    If the answer has helped you, could you please mark the topic as resolved? Kudos are also welcome :-)

 

Warm Regards,

 

Nikhil Thampi

Six Stars

Re: how to filter the column data using Tmap or using any other component.?

As i m using Talend open source . The dimension column will be keep on changing every time, the columns inside the dimension its not constant. So i have kept it in single column.

 

after converting the json to csv file these are the columns data has.

 

I need to filter the dimension column which is having InstanceID based on the ID.

Employee

Re: how to filter the column data using Tmap or using any other component.?

Hi,

 

    Could you please provide the sample data in a csv file and file share it to Talend community?

 

    It is very difficult to setup and data from screen shots. 

 

Warm Regards,

 

Nikhil Thampi

Six Stars

Re: how to filter the column data using Tmap or using any other component.?

Could you please share ur mail ID. so can send u the sample file to ur mail.

Employee

Re: how to filter the column data using Tmap or using any other component.?

Hi,

 

     Please post it in community as attachment after removing confidential details. The aim of the community is that everyone can learn together. So if the attachment is available in community, it will help everyone to learn :-)

 

Warm Regards,

 

Nikhil Thampi

Six Stars

Re: how to filter the column data using Tmap or using any other component.?

Please find the attached sample file for ur reference. We need to filter the column based on InstanceID.

Employee

Re: how to filter the column data using Tmap or using any other component.?

Hi,

 

    Please refer the below job flow for results.

image.png

 

The component screenshots are as below.image.pnginput excel read

 

image.pngJson extract

 

image.pngremove empty rows

 

image.pngtFlowtoIterate

 

image.pngtrowgenerate

 

image.pngoutput in separate files

 

Please refer the output files below.

 

image.pngimage.pngimage.png

 

 

Could you please mark the topic as resolved since solution has been provided? Kudos are also welcome :-)

 

Warm Regards,

 

Nikhil Thampi

Six Stars

Re: how to filter the column data using Tmap or using any other component.?

Thank you so much for the solution. I ll implement it in my job. If  get any doubt i will reply back.

Six Stars

Re: how to filter the column data using Tmap or using any other component.?

Hi Nikhil,

 

I have one more requirement . I have to split the columns which are inside the column,

I have attached the file. Please let me know how to split property column furthur.

 

  

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

How OTTO Utilizes Big Data to Deliver Personalized Experiences

Read about OTTO's experiences with Big Data and Personalized Experiences

Blog

Best Practices for Using Context Variables with Talend – Part 4

Pick up some tips and tricks with Context Variables

Blog

Talend Integration with Databricks

Take a look at this video about Talend Integration with Databricks

Watch Now