Reg: How to capture no.of insert,update and delete for a table in TIS

One Star

Reg: How to capture no.of insert,update and delete for a table in TIS

Hi All,
The option of capturing total no.fo records affected in TIS is available. I want to capture how many no.of records inserted, updated and deleted for a particular table through TISEE 3.2.3. Is there any metadata table supported by Talend to capture these statistics information at table level. Also in my designer window I can see no.of records inserted into a table/sec, when I check statistics option while executing a job. How can I capture these information into a table.
Thanks
Najeeb
Community Manager

Re: Reg: How to capture no.of insert,update and delete for a table in TIS

Hello
Add a tFlowMeter component between input component and output component, and then using tFlowMeterCatcher to catch the no of records. For example:
tFileInput--->tFlowMeter--->tMysqlOutput_1
tFlowMeterCatcher---tLogRow
There is one column called count on the schema of tFlowMeterCatcher which counts the no. of records pass by the specify flow.
Best regards
Shong
----------------------------------------------------------
Talend | Data Agility for Modern Business
One Star

Re: Reg: How to capture no.of insert,update and delete for a table in TIS

Is there a way to capture which of the rows that got inserted/updated from that consolidated count captured by the tFlowMeter in tFileInput--->tFlowMeter--->tMysqlOutput_1 ?
One Star

Re: Reg: How to capture no.of insert,update and delete for a table in TIS

Hello All,
Is there a way to capture which of the rows that got inserted/updated from that consolidated count captured by the tFlowMeter in tFileInput--->tFlowMeter--->tMysqlOutput_1 ?

Any response for this yet? I need this also Smiley Sad
Btw, I am using TOS-Win32-r41260-V4.0.1
Kindly help. Tnx in advance
Community Manager

Re: Reg: How to capture no.of insert,update and delete for a table in TIS

Hi
Is there a way to capture which of the rows that got inserted/updated from that consolidated count captured by the tFlowMeter in tFileInput--->tFlowMeter--->tMysqlOutput_1 ?

The CDC(Change Data Capture) feature in TIS can fit your need, it capture all the change rows, include inserted/updated/deleted rows.
Best regards
Shong
----------------------------------------------------------
Talend | Data Agility for Modern Business
One Star

Re: Reg: How to capture no.of insert,update and delete for a table in TIS

Sir sHong,
The CDC(Change Data Capture) feature in TIS can fit your need, it capture all the change rows, include inserted/updated/deleted rows.

what about in TOS? Smiley Sad
Community Manager

Re: Reg: How to capture no.of insert,update and delete for a table in TIS

Hi
In TOS, we only count the number of rows are inserted/updated/deleted, not the rows. For examle:
tFileInputDelimited---tMysqlOutput_1
There are some global variables counts the number of row are inserted/updated/deleted. Such as:
((Integer)globalMap.get("tMysqlOutput_1_NB_LINE_INSERTED"))

Best regards
Shong
----------------------------------------------------------
Talend | Data Agility for Modern Business
One Star

Re: Reg: How to capture no.of insert,update and delete for a table in TIS

Hi Shong,
I have used ((Integer)globalMap.get("tMysqlOutput_1_NB_LINE_INSERTED")) in tFileInputDelimited---tMysqlOutput_1 mapping also I have tried tFileInputDelimited---tmap---tMysqlOutput_1 .
But I am getting nothing except NULL.
Could you guide me?
Thanks in Advannce
Santhosh
Moderator

Re: Reg: How to capture no.of insert,update and delete for a table in TIS

Hi Santhosh,

Have your data been inserted into MySql DB successfully? Could you please share your job design screenshot with us?
Best regards
Sabrina
--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
One Star

Re: Reg: How to capture no.of insert,update and delete for a table in TIS

Hi,
I am also using the globalmap to get the number of inserseted/rejected rows.
But it return null only.
(Integer)globalMap.get("tOracleOutput_2_NB_LINE_INSERTED")
(Integer)globalMap.get("tOracleOutput_2_NB_LINE_REJECTED")
Thanks
Community Manager

Re: Reg: How to capture no.of insert,update and delete for a table in TIS

These global variables can be accessible in next subjob, for example:
tFileInputDelimited--main--tOracleOutpu
   |
onsubjobok
    |
tJava
on tJava, you can access these global variables to populate the total numbers of inserted/updated/deleted rows.
Shong
----------------------------------------------------------
Talend | Data Agility for Modern Business

Calling Talend Open Studio Users

The first 100 community members completing the Open Studio survey win a $10 gift voucher.

Start the survey

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Best Practices for Using Context Variables with Talend – Part 4

Pick up some tips and tricks with Context Variables

Blog

How Media Organizations Achieved Success with Data Integration

Learn how media organizations have achieved success with Data Integration

Read

APIs for Dummies

View this on-demand webinar about APIs....

Watch Now