I have a problem using fFileList. I am using it to read files one by one with it and process each file. A read file sometimes contains invalid data and causes job to break. How would I prevent that in case of invalid data in one file. I would still like other files to get processed?
Do I need to make changes with/in the tFileList.
What do you mean by invalid data? Is it a schema mismatch? If that is the case you can use a tSchemaComplianceCheck to ensure incoming data matches a required schema, length, nullability, etc.
i will suggest you to use On Component Error of tFileinputDelimited to tSendmail.so that you will understand that which file is not correct one and even your next file will executed.
if you want to send a mail ,then you can use do the same why on db outpout component.
since your db component throwing error means ,you should fix the error to load that data right? if your current file is not proper format then use that on component error on the db component to email component.
Talend named a Leader.
Kickstart your first data integration and ETL projects.
Watch the recorded webinar!
Pick up some tips and tricks with Context Variables
Learn how media organizations have achieved success with Data Integration
Look at6 ways to start utilizing Machine Learning with Amazon We Services and Talend