did not find registered driver with class name java.sql.Driver

Highlighted
Five Stars

did not find registered driver with class name java.sql.Driver

I am using talend big data platform in that I have created a talend big data spark batch job. In that I have placed tHdfsconfiguration tjdbcconfiguration and tjdbcinput in job.
My goal is to read from MSSQL to HDFS.

But while running job , I'm getting error like below-

Did not find registered driver with class name java.sql.Driver

I have added jar from local to tjdbcconfiguration from Select Module.

Is there any configuration which I'm missing.?

Accepted Solutions
Five Stars

Re: did not find registered driver with class name java.sql.Driver

Issue was fixed by supplying jars through option of spark.yarn.jars and placing them on globe like hdfs.

Thanks all for support

All Replies
Seven Stars

Re: did not find registered driver with class name java.sql.Driver

Download Microsoft JDBC Driver for SQL Server (jar file) from https://mvnrepository.com/artifact/com.microsoft.sqlserver/mssql-jdbc/6.2.2.jre8

In your Talend Job in tPrejob flow add a tLibraryLoad component and browse and select downloaded Jar.
Five Stars

Re: did not find registered driver with class name java.sql.Driver

I have already included mssql-jdbc-6.00.jar in tjdbcconfiguration and selected same in Select Module of tjdbcconfiguration.
And I also tried importing this jar using tLibraryLoad and it says selected module already installed.
So it means mssql-jdbc-6.00.jar already exists.
I have tried connecting to spark-shell --jars mssql-jdbc-600.jar

It's working well in spark shell. Looks like this jar is not available to worker node when running through Talend Big data.
Five Stars

Re: did not find registered driver with class name java.sql.Driver

Issue was fixed by supplying jars through option of spark.yarn.jars and placing them on globe like hdfs.

Thanks all for support

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Put Massive Amounts of Data to Work

Learn how to make your data more available, reduce costs and cut your build time

Watch Now

How OTTO Utilizes Big Data to Deliver Personalized Experiences

Read about OTTO's experiences with Big Data and Personalized Experiences

Blog

Talend Integration with Databricks

Take a look at this video about Talend Integration with Databricks

Watch Now