Talend for Big Data - Newbie

Four Stars

Talend for Big Data - Newbie

Hi, 

 

I am newbie for Talend and evaluating it, appreciate if you can provide your feedback on the below..

 

Planning to replace Ab Inito with Talend for Big Data to create Spark jobs on the Hadoop. Thus, at the high level, I would need to find out where Talend can map to existing experience.

 

- Talend should be able to support complex ETL tasks to curate/model the data to create snowflake and denormalized views. Is there any limitations on typical use-cases to curate big data and then create marts on the Hive Orc/Parquet?

- Talend generates Spark code, if customization is required, how easy to maintain it?

- Is Talent creating optimized code for Spark or optimization is done further?

- Is the Spark code Spark SQL based and is it the latest versions?

- Is the generated Spark code covering checkpoints so that if the job fails, it can continue after the issue is fixed?

- How to implement meta-data driven ETL with Talend for Big Data?

- Anyhing else you would like to mention as limitation, work around, etc..

 

Thanks in advance.

CK

Moderator

Re: Talend for Big Data - Newbie

Hello,

Please right size your solution.

Talend bigdata products matric page:https://www.talend.com/products/big-data-compare-all/ and feature pages:

https://www.talend.com/products/big-data/big-data-open-studio/

https://www.talend.com/products/big-data/big-data-entry-level/

https://www.talend.com/products/big-data/big-data-platform/

https://www.talend.com/products/big-data/real-time-big-data/

Best regards

Sabrina

 

--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Put Massive Amounts of Data to Work

Learn how to make your data more available, reduce costs and cut your build time

Watch Now

How OTTO Utilizes Big Data to Deliver Personalized Experiences

Read about OTTO's experiences with Big Data and Personalized Experiences

Blog

Talend Integration with Databricks

Take a look at this video about Talend Integration with Databricks

Watch Now