Parquet Components

Seven Stars

Parquet Components

Hi All,

 

I have requirement where i need to use Parquet Component, but i can see that parquet can be used in Big data batch , is there any way were i can use these components in standard jobs ?

 

or are there any other components which can replace Parquet components?

 

Thanks,

lmit

Six Stars

Re: Parquet Components

You can create a hive table with parquet serde on the location that is required and insert data from the hive table of the previous file.

Hive tmp table(any file format) to Hive table (parquet file format) this is one thing i could think of ?

 

Can you explain your use case ?

Seven Stars

Re: Parquet Components

Thanks rvtj for your reply.

My use case is that we are just using parquet component to store in blob. As parquet files are the most compressed files.

Thanks,
Lmit
Forteen Stars

Re: Parquet Components

@lmit,Parquet Components only be available if you create a Big Data Batch job in licensed Talend Bigdata.

Manohar B
Don't forget to give kudos/accept the solution when a replay is helpful.
Moderator

Re: Parquet Components

Hello,

Please feel free to vote for this new feature jira issue:https://jira.talendforge.org/browse/TBD-4349

Best regards

Sabrina

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Self-service Talend Migration: Moving from On-Premises to the Cloud

Move from On-Premises to the Cloud by following the advice of experts

Read Now

Modern Data Engineering in the Cloud

Learn about modern data engineering in the Cloud

Watch Now

How to deploy Talend Jobs as Docker images to Amazon, Azure and Google Cloud reg...

Learn how to deploy Talend Jobs as Docker images to Amazon, Azure and Google Cloud registries

Blog