Talend for Big Data - Newbie

Four Stars

Talend for Big Data - Newbie



I am newbie for Talend and evaluating it, appreciate if you can provide your feedback on the below..


Planning to replace Ab Inito with Talend for Big Data to create Spark jobs on the Hadoop. Thus, at the high level, I would need to find out where Talend can map to existing experience.


- Talend should be able to support complex ETL tasks to curate/model the data to create snowflake and denormalized views. Is there any limitations on typical use-cases to curate big data and then create marts on the Hive Orc/Parquet?

- Talend generates Spark code, if customization is required, how easy to maintain it?

- Is Talent creating optimized code for Spark or optimization is done further?

- Is the Spark code Spark SQL based and is it the latest versions?

- Is the generated Spark code covering checkpoints so that if the job fails, it can continue after the issue is fixed?

- How to implement meta-data driven ETL with Talend for Big Data?

- Anyhing else you would like to mention as limitation, work around, etc..


Thanks in advance.



Re: Talend for Big Data - Newbie


Please right size your solution.

Talend bigdata products matric page:https://www.talend.com/products/big-data-compare-all/ and feature pages:





Best regards



Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Put Massive Amounts of Data to Work

Learn how to make your data more available, reduce costs and cut your build time

Watch Now

How OTTO Utilizes Big Data to Deliver Personalized Experiences

Read about OTTO's experiences with Big Data and Personalized Experiences


Talend Integration with Databricks

Take a look at this video about Talend Integration with Databricks

Watch Now

How to Modernize Your Cloud Platform for Big Data Analytics With Talend and Micr...

Learn how<SPAN>to modernize your Cloud Platform for Big Data Analytics with Talend and Microsoft Azure</SPAN>