tDataShuffle - generating duplicate values

Highlighted
Seven Stars

tDataShuffle - generating duplicate values

Hi,

 

I have a 5 independent unique columns and I am doing tDataShuffling on the 4 fields with Group ID 1 to 5.

The result is giving me rows - with duplicates with 2 of the columns.

 

Example:

Field1(type - String 15) = 1,2,3,4,5,6 - group 1

Filed2(type - Binary Decimal 15) = 11,12,13,14,15,16 - group 2

Field3(type - String 30) = 21, 22, 23, 24, 25, 26 - group 3

Field4(type - String 30) = 31, 32, 33, 34, 35, 36 - group 4

Field5(type - Binary Decimal 10) = 41, 42, 43, 44, 45, 46 - group 5

 

Expected: (shuffle independently)

Field1 = 2,3,5,1,6,4

Filed2 = 13,11,14,16,15,12

Field3 = 26, 25, 24, 23, 22, 21

Field4 = 35, 36, 34, 33, 31, 32

Field5 = 44, 41, 46, 43, 42, 45

 

Actual output:

Field1 = 2,3,2,1,6,4

Filed2 = 13,11,14,16,15,12

Field3 = 26, 25, 24, 26, 22, 21

Field4 = 35, 36, 34, 33, 31, 32

Field5 = 44, 41, 46, 43, 42, 45

 

I see the duplicated created are in String type or group 1 & 3.

The random generator and buffer size are of default value.

 

Please advice.

 

Thanks

 


Accepted Solutions
Highlighted
Moderator

Re: tDataShuffle - generating duplicate values

Hello,

Could you please clarify in which Talend version/edition you are?

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.

View solution in original post


All Replies
Highlighted
Moderator

Re: tDataShuffle - generating duplicate values

Hello,

Could you please clarify in which Talend version/edition you are?

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.

View solution in original post

2019 GARTNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

Introduction to Talend Open Studio for Data Quality

Find out about Talend Open Studio for Data Quality

Watch Now

Enabling Data Governance

Learn how to enable Data Governance

Watch Now

The Definitive Guide to Government Data Quality

Take a peek at the definitive guide to Government Data Quality

Read