Six Stars

Need to generate one trillion record data using any component

Hi Talend Folks,

 

                   Whether it is possible to create one trillion record data using tRowGenerator in Talend? 

I need generate one trillion record in csv file.  Suppose tRowGenerator is can't generate one trillion record data means any other component is there?

  • Big Data
  • Data Integration
  • ESB
  • Exchange components
  • Sandbox
  • SDI
  • Talend Integration Cloud
2 ACCEPTED SOLUTIONS

Accepted Solutions
Nine Stars TRF
Nine Stars

Re: Need to generate one trillion record data using any component

tRowGenerator is limited by Integer capacity (for the number of generated rows).

So you have to iterate over the tRowGenerator to be complient with this "limitation" or use a tJava component to do what you want.


TRF
Nine Stars TRF
Nine Stars

Re: Need to generate one trillion record data using any component

Did this help? If so, thanks to mark this case as solved.

Kudos also accepted.


TRF
2 REPLIES
Nine Stars TRF
Nine Stars

Re: Need to generate one trillion record data using any component

tRowGenerator is limited by Integer capacity (for the number of generated rows).

So you have to iterate over the tRowGenerator to be complient with this "limitation" or use a tJava component to do what you want.


TRF
Nine Stars TRF
Nine Stars

Re: Need to generate one trillion record data using any component

Did this help? If so, thanks to mark this case as solved.

Kudos also accepted.


TRF