Create a Json and send to BigQuery as a nested fields

Four Stars

Create a Json and send to BigQuery as a nested fields

 Hello,

I'm trying to create the following flow:

1. Read from 3 DB tables and join them  (Done)

2. Create from the DB data a JSON field (using tWriteJSONField) - Done

3. Send the results to other DB (Big Query) in the following format: column 1: string, column 2: JSON

For example:

tWriteJSONField output is many JSONs string as the following:  (url is the loop element).

{"url":"http://google.com/","id":"3","type":"28","sub_type":"3","exp":[],"or":"3","date":"19-05-2015","num":...

 

 

I need the final format to be as the follow:

"http://google.com/", {"id":"3","type":"28","sub_type":"3","exp":[],"or":"3","date":"19-05-2015","num":[]}} 

 

According to the scheme I defined in tWriteJSONField , the JSON string appears in the column "url" and the rest are null / 0:  |0 |null|null    |null|null|null|null|null       |

 

How can I define the JSON scheme that will generate only the "url" and the JSON string?

 

Screenshots are attached.

 

Thanks,

Emma

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

How OTTO Utilizes Big Data to Deliver Personalized Experiences

Read about OTTO's experiences with Big Data and Personalized Experiences

Blog

Best Practices for Using Context Variables with Talend – Part 4

Pick up some tips and tricks with Context Variables

Blog

Talend Integration with Databricks

Take a look at this video about Talend Integration with Databricks

Watch Now