I want to send source data in to final ware house every 15 minutes ,So I taught to create a control table in
staging area with DATE,TIMESTAMP as columns
When the table in the source is updated , for example the source table is (sales_order ) the date column in sales_order is
(sales_order_date ) when the sales_order_date column gets updated the time is greater than TIME_STAMP column in staging then staging table should fetch the data from source to staging .
But how to replicate the column in control table in staging to give as condition in source .please help me to do it
or if any other solutions better than this please let me know
Thanks in advance
Solved! Go to Solution.
Would you mind posting your current job design screenshots on forum which will be helpful for us to understand your requirement very weel?
hello Shong,as per your suggesion i created 2 context variable but when i connecting run if condition it cant be connected to output, and How to set run if condition (TalendDate.compareDate(context.controlDate, context.sourceDate)==1
) means where to set condition???? i attached the screen shot of my job.
Talend named a Leader.
Kickstart your first data integration and ETL projects.
Watch the recorded webinar!
Pick up some tips and tricks with Context Variables
Learn how media organizations have achieved success with Data Integration
Create systems and workflow to manage clean data ingestion and data transformation.