Talend Job Redshiftrow Copy Command Error

Four Stars

Talend Job Redshiftrow Copy Command Error

Hi ,

 

Can anybody help me,while i am running talend job with copy command its throwing error like:

insufficient data left in message during my COPY from S3 to Redshift.

 

Can anybody help me.

 

 

Regards,

Prasanth

Highlighted
Twelve Stars

Re: Talend Job Redshiftrow Copy Command Error

why You still do not want check what redshift think about this?
https://docs.aws.amazon.com/redshift/latest/dg/r_STL_LOAD_ERRORS.html

 

just

select * from stl_load_errors order by starttime desc;

It can give You more information about error

Screen Shot 2018-02-21 at 20.06.28.png

Screen Shot 2018-02-21 at 20.07.42.png

-----------
Four Stars

Re: Redshift Copy Command Error

Thank you vapukov.

 

Now i am getting different error which is "extra columns found". while loading data into redshift from s3.

 

could you please help me.

 

Thank you.

Twelve Stars

Re: Redshift Copy Command Error


PALIVELATalend wrote:

Thank you vapukov.

 

Now i am getting different error which is "extra columns found". while loading data into redshift from s3.

 

could you please help me.

 

Thank you.


answer already in Your question Smiley Happy

 

investigate Your data! it mean:

- data do not proper escaped

- one(few) of rows contain separator character in column value, like

  • this is somedata, about something
  • this is another ~ similar data

1st will be detected as 2 column with "," separator, 2nd with "~" separator

-----------