One Star

How can to run Big data jobs or Spark Jobs?

I have few basic question on the execution of Big data jobs 
- Does the Talend Big data jobs need to be directly run on Hadoop cluster or can be triggered from other servers ?
-Can the Big data jobs be triggered through TAC ?
-If we generate the jars can the jobs be triggered through talend execution server ?
- If we are using a 3rd party scheduler like control-m how can we schedule the Talend Big data jobs?
Regards
Nishant
1 REPLY
Moderator

Re: How can to run Big data jobs or Spark Jobs?

Hi,
Does the Talend Big data jobs need to be directly run on Hadoop cluster or can be triggered from other servers ?

What does your current bigdata job look like? Are you using tHDFSxxx component in your work flow?
Can the Big data jobs be triggered through TAC ?

Talend Administration Center is a web-based application delivered with the Job Conductor, Big Data Streaming Conductor and ESB Conductor modules.
Please refer to document about:TalendHelpCenter:Executing Jobs Routes and Services
If we are using a 3rd party scheduler like control-m how can we schedule the Talend Big data jobs

 You can export the job script, and then schedule it with third scheduler tool.
Here is document about:TalendHelpCenter:How to build Jobs
Best regards
Sabrina
--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.