Talend Job Redshiftrow Copy Command Error

Highlighted
Four Stars

Talend Job Redshiftrow Copy Command Error

Hi ,

 

Can anybody help me,while i am running talend job with copy command its throwing error like:

insufficient data left in message during my COPY from S3 to Redshift.

 

Can anybody help me.

 

 

Regards,

Prasanth

Forteen Stars

Re: Talend Job Redshiftrow Copy Command Error

why You still do not want check what redshift think about this?
https://docs.aws.amazon.com/redshift/latest/dg/r_STL_LOAD_ERRORS.html

 

just

select * from stl_load_errors order by starttime desc;

It can give You more information about error

Screen Shot 2018-02-21 at 20.06.28.png

Screen Shot 2018-02-21 at 20.07.42.png

-----------
Four Stars

Re: Redshift Copy Command Error

Thank you vapukov.

 

Now i am getting different error which is "extra columns found". while loading data into redshift from s3.

 

could you please help me.

 

Thank you.

Forteen Stars

Re: Redshift Copy Command Error


@PALIVELATalend wrote:

Thank you vapukov.

 

Now i am getting different error which is "extra columns found". while loading data into redshift from s3.

 

could you please help me.

 

Thank you.


answer already in Your question Smiley Happy

 

investigate Your data! it mean:

- data do not proper escaped

- one(few) of rows contain separator character in column value, like

  • this is somedata, about something
  • this is another ~ similar data

1st will be detected as 2 column with "," separator, 2nd with "~" separator

-----------

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Migrate Data from one Database to another with one Job using the Dynamic Schema

Find out how to migrate from one database to another using the Dynamic schema

Blog

Talend Cloud Developer Series – Defining Metadata

This video focuses on different methods of adding metadata to a job in Talend Cloud

Watch Now

Talend Cloud Developer Series – Updating Context Variables

This video will show you how to add context parameters to a job in Talend Cloud

Watch Now