Issue with JSON generated by TDynamoDBInput

One Star

Issue with JSON generated by TDynamoDBInput

Hi, thanks in advance for your support and responses

 

We are using the TDynamoDBInput component to connect to a Dynamo DB table and dump the records.

The JSON which gets dumped is of the below format (Please note this is indicative and not actual values)

 

{key1 = { key2=value2 , key3=value3}}

 

Now the issue faced by us is that this is not identified as a valid JSON by Redshift Spectrum or any JSON parsing tool

since an ideal JSON would be

{"key1" : { "key2":"value2" , "key3":"value3"}}

 

( Note the double quotes / Colon which are required in a well structured JSON)

 

Are we doing something incorrect. Can you please guide.

As such the generated JSON by DynamoDB input cannot be used by any tool which parses JSON.

 

Thnaks

 

Four Stars

Re: Issue with JSON generated by TDynamoDBInput

I just fought with this same issue.  DynamoDB uses what it calls DynamoDB JSON, which is not formatted like a classic JSON string.  What I ended up doing was using the tReplace connector to reformat the JSON string into something usable and then used tExtractJSONFields to break down the JSON string into it's usable parts.

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Put Massive Amounts of Data to Work

Learn how to make your data more available, reduce costs and cut your build time

Watch Now

How OTTO Utilizes Big Data to Deliver Personalized Experiences

Read about OTTO's experiences with Big Data and Personalized Experiences

Blog

Talend Integration with Databricks

Take a look at this video about Talend Integration with Databricks

Watch Now