Talend Job Redshiftrow Copy Command Error

Four Stars

Talend Job Redshiftrow Copy Command Error

Hi ,

 

Can anybody help me,while i am running talend job with copy command its throwing error like:

insufficient data left in message during my COPY from S3 to Redshift.

 

Can anybody help me.

 

 

Regards,

Prasanth

Forteen Stars

Re: Talend Job Redshiftrow Copy Command Error

why You still do not want check what redshift think about this?
https://docs.aws.amazon.com/redshift/latest/dg/r_STL_LOAD_ERRORS.html

 

just

select * from stl_load_errors order by starttime desc;

It can give You more information about error

Screen Shot 2018-02-21 at 20.06.28.png

Screen Shot 2018-02-21 at 20.07.42.png

-----------
Four Stars

Re: Redshift Copy Command Error

Thank you vapukov.

 

Now i am getting different error which is "extra columns found". while loading data into redshift from s3.

 

could you please help me.

 

Thank you.

Forteen Stars

Re: Redshift Copy Command Error


@PALIVELATalend wrote:

Thank you vapukov.

 

Now i am getting different error which is "extra columns found". while loading data into redshift from s3.

 

could you please help me.

 

Thank you.


answer already in Your question Smiley Happy

 

investigate Your data! it mean:

- data do not proper escaped

- one(few) of rows contain separator character in column value, like

  • this is somedata, about something
  • this is another ~ similar data

1st will be detected as 2 column with "," separator, 2nd with "~" separator

-----------

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Talend Cloud Available on Microsoft Azure

An integration platform-as-a-serviceto help enterprises collect, govern, transform, and share data from any data sources

Watch Now

Self-service Talend Migration: Moving from On-Premises to the Cloud

Move from On-Premises to the Cloud by following the advice of experts

Read Now

How to deploy Talend Jobs as Docker images to Amazon, Azure and Google Cloud reg...

Learn how to deploy Talend Jobs as Docker images to Amazon, Azure and Google Cloud registries

Blog