I have build job from studio and unable to run job from TAC and nexus as well.
Not able to generate spark-submmit commands or command not placing file into HDFS.
tsystem--->subok--->thdfslist -->no file-->tdie(messgae: file not found)
tsystem: we are calling spark-summit command
Functionalities of spark-commands--> place file into hdfs.
But i am able run job in jobserver using below command its working fine. Let us know any parameter need to set in TAC or job level.
commands: sh jobname.sh
Thanks in advance
What's error message are you facing?
No error message such. using tSystem_1 component will hit Saprk-summit commands to hortonworks cluster.
May i know anything to add cluster ipaddressort add in TAC ?
No error message in log? Is your Studio/TAC the same operating system type? Maybe a difference regarding system variables such as Path or user rights (probably not the same for the Studio and for the TAC).
Error message is "Filenot found." Same code work for old hadoop cluster but not working in new cluster.
We checked with admin there no change in old and new cluster.
May i know anything add cluster in TAC or jobserver.
Could you please do the echo command in tsystem and see whether its working while running through TAC?
I would echo hostname, current directory, PATH variable etc. to see whether there is any issue due to relative path for job name.
Please appreciate our Talend community members by giving Kudos for sharing their time for your query. If your query is answered, please mark the topic as resolved :-)
Try Talend Cloud free for 30 days.
Introduction to Talend Open Studio for Data Integration.
Practical steps to developing your data integration strategy.
Create systems and workflow to manage clean data ingestion and data transformation.