Talend data validation coverage.

Highlighted
One Star

Talend data validation coverage.

Hi,

On our project we need to load some .csv files from Amazon S3 and after processing the data, we need to dump the data into the PostreSQL and then generate report with connected open source BI tool Saiku.

Currently we judge the data generating report through saiku and comparing it with results of our own written sql queries.

Please tell me, can we automate, all this ETL + Testing process through Talend?

If yes, then how?

Please provide explanatory reply. I'll be very thankful for this help.
Four Stars

Re: Talend data validation coverage.

Hi,
- You can export your Saiku reports to csv or excel
- Use your sql query as input
- use tMap to join the records with lookup as your sql query and input as Saiku exported csv/excel
Using this you can get the reject / match records.

Thanks
Vaibhav

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Enabling Data Governance

Learn how to enable Data Governance

Watch Now

The Definitive Guide to Government Data Quality

Take a peek at the definitive guide to Government Data Quality

Read