question about Talend open source DQ

Highlighted
Six Stars

question about Talend open source DQ

Hello,

we are going to receive csv files to then upload in our system. I would like to understand if the Open Source Data Quality is the right tool to do the following jobs.

1) Ensure that all the necessary columns are present
2) control if the key and some column have no null values and duplicates
3) control if the columns are within a defined length
4) control if the columns are within a defined list of values
5) ...

Thanks for your comments.
Employee

Re: question about Talend open source DQ

Hello,

yes, you need to create a file delimited connection, then you can profile its content with a column analysis.
Six Stars

Re: question about Talend open source DQ

Thanks, for your reply

So on the column analysis you can put a list of values? But you can also write an SQL to get the value list from a data source?

I'm going to try it.

Again thanks for your help.
One Star

Re: question about Talend open source DQ

Is it possible to connect Hive database in Talend Data Quality. When i tried its not connecting properly.
Moderator

Re: question about Talend open source DQ

Hi vinothrajan,
Is it possible to connect Hive database in Talend Data Quality. When i tried its not connecting properly.

It is possible to achieve that in Talend open source DQ.
Please have a look at document TalendHelpCenter:Connecting to a database with Hive section.

Best regards
Sabrina
--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Introduction to Talend Open Studio for Data Quality

Find out about Talend Open Studio for Data Quality

Watch Now

Enabling Data Governance

Learn how to enable Data Governance

Watch Now

The Definitive Guide to Government Data Quality

Take a peek at the definitive guide to Government Data Quality

Read