Watch file for specific time interval

Six Stars

Watch file for specific time interval

Hi,

I need to implement a job that will watch file for specific interval and generate notification.

 

Thanks

Fifteen Stars TRF
Fifteen Stars

Re: Watch file for specific time interval

Schedule the task with the desired interval (using TAC or an external scheduler) or use tSleep to introduce the wait strategy into the job.

In this case you should anticipate a condition to break the infinite loop.


TRF
Forteen Stars

Re: Watch file for specific time interval

all what suggested by @TRF, also:

 

- look for ESB, where You can create route which monitor folders

- Use remote agents with could ship files (or file content)

 

last also allow tail file in "real-time" to message queue

 

-----------
Six Stars

Re: Watch file for specific time interval

Hi,

 

This is what I need to implement

System should perform below validations for file reception
 - File should be received by stipulated (configured time) time for particular Issuer
 - For each issuer two files should be present – Main and Meta

 If file not received by stipulated time, then system should retry up to configured number of times
 - System should retry after configured duration

 

Can you please elaborate how to implement this. The directory that needs to be scanned will have multiple files coming , I need to scan this folder, read these files and do validations and processing.

 

Appreciate your co-operation and timely help.

 

Thanks,

Pravin Sanadi

Forteen Stars

Re: Watch file for specific time interval

- Schedule Job as usual - by any scheduler

 

Job structure:

- tLoop with number of iteration what You want to re-try

- iterate to next steps:

- tFileExists for both of files 

- trigger IF exists both - run all steps and exit Loop

- trigger IF not exists both - tSleep for predicted number of seconds

- after tSleep if number of current iteration == maximum defined - notify about unsuccessful execution

 

 

Above - simple sequence for single issuer, but You can extend it for iterate thru all defined issuers

-----------

15TH OCTOBER, COUNTY HALL, LONDON

Join us at the Community Lounge.

Register Now

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Best Practices for Using Context Variables with Talend – Part 4

Pick up some tips and tricks with Context Variables

Blog

How Media Organizations Achieved Success with Data Integration

Learn how media organizations have achieved success with Data Integration

Read

6 Ways to Start Utilizing Machine Learning with Amazon We Services and Talend

Look at6 ways to start utilizing Machine Learning with Amazon We Services and Talend

Blog