Six Stars

Parquet Components

Hi All,

 

I have requirement where i need to use Parquet Component, but i can see that parquet can be used in Big data batch , is there any way were i can use these components in standard jobs ?

 

or are there any other components which can replace Parquet components?

 

Thanks,

lmit

4 REPLIES
Six Stars

Re: Parquet Components

You can create a hive table with parquet serde on the location that is required and insert data from the hive table of the previous file.

Hive tmp table(any file format) to Hive table (parquet file format) this is one thing i could think of ?

 

Can you explain your use case ?

Six Stars

Re: Parquet Components

Thanks rvtj for your reply.

My use case is that we are just using parquet component to store in blob. As parquet files are the most compressed files.

Thanks,
Lmit
Twelve Stars

Re: Parquet Components

@lmit,Parquet Components only be available if you create a Big Data Batch job in licensed Talend Bigdata.

Manohar B
Moderator

Re: Parquet Components

Hello,

Please feel free to vote for this new feature jira issue:https://jira.talendforge.org/browse/TBD-4349

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.