Four Stars

Big Data Batch Job Iteration

Hello,

Our team is looking to iterate through HDFS file system and transform files using tfileoutputparquet.

How would one go about using a tFileList and or a tHdfsList component to iterate through?

Could someone point our team in the right direction to perform this function if possible?

 

 

Regards,

Jonathan

  • Big Data
2 REPLIES
Moderator

Re: Big Data Batch Job Iteration

Hi,

So far, tFileList and tHdfsList components are not available in bigdata batch job.

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
Four Stars

Re: Big Data Batch Job Iteration

Thank you Sabrina,

Are there any alternatives regarding iteration in a Big Data Batch job?

 

Regards,

Jonathan