JDBC for Google BigQuery

Highlighted
Six Stars

JDBC for Google BigQuery

Hello everyone,

I configured my job to run with google bigquery via JDBC DB (because i want to use table schema).

I connected to the google big query environment but when i want to insert the data i came across with the error "

java.lang.RuntimeException: [Simba][JDBC](10220) Driver does not support this optional feature.

so please help thanks 

Thirteen Stars

Re: JDBC for Google BigQuery

does you use autocommit or manual commit?

-----------
Six Stars

Re: JDBC for Google BigQuery

Hi Vapukov;

I could not see auto commit tick in the component only I see commit every ... rows section

Six Stars

Re: JDBC for Google BigQuery

I found a solution using a tdbinput component before tdbinput i used tdbconnection in the tdbconnection component i deactivated "auto commit" and it is done for insert but when i want to use update or insert then another error show up ```

message" : "Syntax error: Unexpected end of statement at [1:53] ```

Thirteen Stars

Re: JDBC for Google BigQuery

let's fist check 2 moments:

- can you extract table schema with jdbc driver? (because you mention this as primary reason)

- do you test standard BigQueryOutput component, is it work for you?

 

if yes for both - you can use schema from repository from any type of connection, it is just a schema

if not - need to test disable batch window, set commit to 1 and look what sql generated by job

-----------
Six Stars

Re: JDBC for Google BigQuery

i can use extract schema from jdbc driver no problem.

the BigQuery component is not working properly the error is "empty key"

"if not - need to test disable batch window, set commit to 1 and look what sql generated by job" how can i do that i do not know please help thanks 

Four Stars

Re: JDBC for Google BigQuery

Hi Vapukov, Aztec

 

I could able to use tBigQueryOutput to connect to BQ and write the data.

But I used the 'Schema' - 'built-in'. That is good. But the downside is, I must fill in each column name, data type.

I want to use the 'Repository', so I can browse and add the target table.

 

do you know how I can do ? how I do create BQ schema in talend? 

any documentation pointers ?

I would like to use the jdbc drivers. 

 

Thanks

Shanker

Cloud Free Trial

Try Talend Cloud free for 30 days.

Tutorial

Introduction to Talend Open Studio for Data Integration.

Definitive Guide to Data Integration

Practical steps to developing your data integration strategy.

Definitive Guide to Data Quality

Create systems and workflow to manage clean data ingestion and data transformation.