Talend and HortonWorks 2.0a

One Star

Talend and HortonWorks 2.0a

Hi,
I am a new user to Talend and was surprised by its capabilities. While I am trying to make Talend works on top of HortonWorks, I found the HCatelog version pre-set version only includes up to HortonWorks Platform v1.2. Is there a workaround for HortonWorks v2.0a? Or there is no big change, I can proceed with similar configurations.
Regards,
lizgym
Moderator

Re: Talend and HortonWorks 2.0a

Hi,
Not sure it is what are you looking for, in latest version, tHCatalogInput has a new feature of "Custom" option to allows you to connect to a custom Hadoop distribution rather than any of the predefined distributions given in this list.
See my screenshots
Best regards
Sabrina
--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
One Star

Re: Talend and HortonWorks 2.0a

Thanks! I will try the custom definition.
Moderator

Re: Talend and HortonWorks 2.0a

Hi,
Welcome, feel free post your issue on forum. So far, "Custom" option is only available in the latest version(Talend Open Studio products 5.3.0), please pay more attention on it.
Best regards
Sabrina
--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
One Star

Re: Talend and HortonWorks 2.0a

I just ran into the same problem. What exactly should be the content of the imported zip? I zipped hadoop-client-2.2.0.jar and its dependencies and tried to use that, but this gives me the following error:
Import custom definition failed
java.lang.IllegalArgumentException: InputStream cannot be null
javax.xml.parsers.DocumentBuilder.parse(DocumentBuilder.java:117)
org.talend.core.hadoop.version.custom.HadoopCustomLibrariesUtil.readZipFile(HadoopCustomLibrariesUtil.java:312)
org.talend.core.hadoop.version.custom.HadoopVersionDialog.getImportLibLibraries(HadoopVersionDialog.java:445)
org.talend.core.hadoop.version.custom.HadoopCustomVersionDefineDialog$12$1.run(HadoopCustomVersionDefineDialog.java:547)
org.eclipse.swt.widgets.RunnableLock.run(RunnableLock.java:35)
org.eclipse.swt.widgets.Synchronizer.runAsyncMessages(Synchronizer.java:134)
org.eclipse.swt.widgets.Display.runAsyncMessages(Display.java:4041)
org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3660)
org.eclipse.jface.operation.ModalContext$ModalContextThread.block(ModalContext.java:173)
org.eclipse.jface.operation.ModalContext.run(ModalContext.java:388)
org.eclipse.jface.dialogs.ProgressMonitorDialog.run(ProgressMonitorDialog.java:507)
org.talend.core.hadoop.version.custom.HadoopCustomVersionDefineDialog.doImportLibs(HadoopCustomVersionDefineDialog.java:575)
org.talend.core.hadoop.version.custom.HadoopCustomVersionDefineDialog.access$4(HadoopCustomVersionDefineDialog.java:509)
org.talend.core.hadoop.version.custom.HadoopCustomVersionDefineDialog$1.run(HadoopCustomVersionDefineDialog.java:165)
org.eclipse.swt.widgets.RunnableLock.run(RunnableLock.java:35)
org.eclipse.swt.widgets.Synchronizer.runAsyncMessages(Synchronizer.java:134)
org.eclipse.swt.widgets.Display.runAsyncMessages(Display.java:4041)
org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3660)
org.eclipse.jface.window.Window.runEventLoop(Window.java:825)
org.eclipse.jface.window.Window.open(Window.java:801)
org.talend.designer.core.ui.editor.properties.controllers.HadoopJarSetupController$1.widgetSelected(HadoopJarSetupController.java:151)
org.eclipse.swt.widgets.TypedListener.handleEvent(TypedListener.java:234)
org.eclipse.swt.widgets.EventTable.sendEvent(EventTable.java:84)
org.eclipse.swt.widgets.Widget.sendEvent(Widget.java:1053)
org.eclipse.swt.widgets.Display.runDeferredEvents(Display.java:4066)
org.eclipse.swt.widgets.Display.readAndDispatch(Display.java:3657)
org.eclipse.ui.internal.Workbench.runEventLoop(Workbench.java:2640)
org.eclipse.ui.internal.Workbench.runUI(Workbench.java:2604)
org.eclipse.ui.internal.Workbench.access$4(Workbench.java:2438)
org.eclipse.ui.internal.Workbench$7.run(Workbench.java:671)
org.eclipse.core.databinding.observable.Realm.runWithDefault(Realm.java:332)
org.eclipse.ui.internal.Workbench.createAndRunWorkbench(Workbench.java:664)
org.eclipse.ui.PlatformUI.createAndRunWorkbench(PlatformUI.java:149)
org.talend.rcp.intro.Application.start(Application.java:141)
org.eclipse.equinox.internal.app.EclipseAppHandle.run(EclipseAppHandle.java:196)
org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.runApplication(EclipseAppLauncher.java:110)
org.eclipse.core.runtime.internal.adaptor.EclipseAppLauncher.start(EclipseAppLauncher.java:79)
org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:369)
org.eclipse.core.runtime.adaptor.EclipseStarter.run(EclipseStarter.java:179)
sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
java.lang.reflect.Method.invoke(Method.java:606)
org.eclipse.equinox.launcher.Main.invokeFramework(Main.java:619)
org.eclipse.equinox.launcher.Main.basicRun(Main.java:574)
org.eclipse.equinox.launcher.Main.run(Main.java:1407)