On our project we need to load some .csv files from Amazon S3 and after processing the data, we need to dump the data into the PostreSQL and then generate report with connected open source BI tool Saiku.
Currently we judge the data generating report through saiku and comparing it with results of our own written sql queries.
Please tell me, can we automate, all this ETL + Testing process through Talend?
If yes, then how?
Please provide explanatory reply. I'll be very thankful for this help.
Hi, - You can export your Saiku reports to csv or excel - Use your sql query as input - use tMap to join the records with lookup as your sql query and input as Saiku exported csv/excel Using this you can get the reject / match records.