Reg: How to capture no.of insert,update and delete for a table in TIS

One Star

Reg: How to capture no.of insert,update and delete for a table in TIS

Hi All,
The option of capturing total no.fo records affected in TIS is available. I want to capture how many no.of records inserted, updated and deleted for a particular table through TISEE 3.2.3. Is there any metadata table supported by Talend to capture these statistics information at table level. Also in my designer window I can see no.of records inserted into a table/sec, when I check statistics option while executing a job. How can I capture these information into a table.
Thanks
Najeeb
Community Manager

Re: Reg: How to capture no.of insert,update and delete for a table in TIS

Hello
Add a tFlowMeter component between input component and output component, and then using tFlowMeterCatcher to catch the no of records. For example:
tFileInput--->tFlowMeter--->tMysqlOutput_1
tFlowMeterCatcher---tLogRow
There is one column called count on the schema of tFlowMeterCatcher which counts the no. of records pass by the specify flow.
Best regards
Shong
----------------------------------------------------------
Talend | Data Agility for Modern Business
One Star

Re: Reg: How to capture no.of insert,update and delete for a table in TIS

Is there a way to capture which of the rows that got inserted/updated from that consolidated count captured by the tFlowMeter in tFileInput--->tFlowMeter--->tMysqlOutput_1 ?
One Star

Re: Reg: How to capture no.of insert,update and delete for a table in TIS

Hello All,
Is there a way to capture which of the rows that got inserted/updated from that consolidated count captured by the tFlowMeter in tFileInput--->tFlowMeter--->tMysqlOutput_1 ?

Any response for this yet? I need this also Smiley Sad
Btw, I am using TOS-Win32-r41260-V4.0.1
Kindly help. Tnx in advance
Community Manager

Re: Reg: How to capture no.of insert,update and delete for a table in TIS

Hi
Is there a way to capture which of the rows that got inserted/updated from that consolidated count captured by the tFlowMeter in tFileInput--->tFlowMeter--->tMysqlOutput_1 ?

The CDC(Change Data Capture) feature in TIS can fit your need, it capture all the change rows, include inserted/updated/deleted rows.
Best regards
Shong
----------------------------------------------------------
Talend | Data Agility for Modern Business
One Star

Re: Reg: How to capture no.of insert,update and delete for a table in TIS

Sir sHong,
The CDC(Change Data Capture) feature in TIS can fit your need, it capture all the change rows, include inserted/updated/deleted rows.

what about in TOS? Smiley Sad
Community Manager

Re: Reg: How to capture no.of insert,update and delete for a table in TIS

Hi
In TOS, we only count the number of rows are inserted/updated/deleted, not the rows. For examle:
tFileInputDelimited---tMysqlOutput_1
There are some global variables counts the number of row are inserted/updated/deleted. Such as:
((Integer)globalMap.get("tMysqlOutput_1_NB_LINE_INSERTED"))

Best regards
Shong
----------------------------------------------------------
Talend | Data Agility for Modern Business
One Star

Re: Reg: How to capture no.of insert,update and delete for a table in TIS

Hi Shong,
I have used ((Integer)globalMap.get("tMysqlOutput_1_NB_LINE_INSERTED")) in tFileInputDelimited---tMysqlOutput_1 mapping also I have tried tFileInputDelimited---tmap---tMysqlOutput_1 .
But I am getting nothing except NULL.
Could you guide me?
Thanks in Advannce
Santhosh
Moderator

Re: Reg: How to capture no.of insert,update and delete for a table in TIS

Hi Santhosh,

Have your data been inserted into MySql DB successfully? Could you please share your job design screenshot with us?
Best regards
Sabrina
--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
One Star

Re: Reg: How to capture no.of insert,update and delete for a table in TIS

Hi,
I am also using the globalmap to get the number of inserseted/rejected rows.
But it return null only.
(Integer)globalMap.get("tOracleOutput_2_NB_LINE_INSERTED")
(Integer)globalMap.get("tOracleOutput_2_NB_LINE_REJECTED")
Thanks
Community Manager

Re: Reg: How to capture no.of insert,update and delete for a table in TIS

These global variables can be accessible in next subjob, for example:
tFileInputDelimited--main--tOracleOutpu
   |
onsubjobok
    |
tJava
on tJava, you can access these global variables to populate the total numbers of inserted/updated/deleted rows.
Shong
----------------------------------------------------------
Talend | Data Agility for Modern Business