Would like to know
Is there any component or technique to capture record counts of rows going though the data pipeline at various points, into context variables?
Count of rows coming out of tOracleInput
Count of rows coming out of tHDFSOutput
For HDFSOutput I am not able find the global variable for row count.
Here is a tFlowMeterCatcher component which catches the processing volumetric from the tFlowMeter component and passes them on to the output component.
Please take a look at this component reference:https://help.talend.com/display/TalendOpenStudioComponentsReferenceGuide63EN/tFlowMeterCatcher.
Watch the recorded webinar!
Create systems and workflow to manage clean data ingestion and data transformation.
Introduction to Talend Open Studio for Data Integration.
Test drive Talend's enterprise products.