Talend Job Redshiftrow Copy Command Error

Four Stars

Talend Job Redshiftrow Copy Command Error

Hi ,

 

Can anybody help me,while i am running talend job with copy command its throwing error like:

insufficient data left in message during my COPY from S3 to Redshift.

 

Can anybody help me.

 

 

Regards,

Prasanth

Forteen Stars

Re: Talend Job Redshiftrow Copy Command Error

why You still do not want check what redshift think about this?
https://docs.aws.amazon.com/redshift/latest/dg/r_STL_LOAD_ERRORS.html

 

just

select * from stl_load_errors order by starttime desc;

It can give You more information about error

Screen Shot 2018-02-21 at 20.06.28.png

Screen Shot 2018-02-21 at 20.07.42.png

-----------
Four Stars

Re: Redshift Copy Command Error

Thank you vapukov.

 

Now i am getting different error which is "extra columns found". while loading data into redshift from s3.

 

could you please help me.

 

Thank you.

Forteen Stars

Re: Redshift Copy Command Error


@PALIVELATalend wrote:

Thank you vapukov.

 

Now i am getting different error which is "extra columns found". while loading data into redshift from s3.

 

could you please help me.

 

Thank you.


answer already in Your question Smiley Happy

 

investigate Your data! it mean:

- data do not proper escaped

- one(few) of rows contain separator character in column value, like

  • this is somedata, about something
  • this is another ~ similar data

1st will be detected as 2 column with "," separator, 2nd with "~" separator

-----------

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

How to deploy Talend Jobs as Docker images to Amazon, Azure and Google Cloud reg...

Learn how to deploy Talend Jobs as Docker images to Amazon, Azure and Google Cloud registries

Blog

Best Practices for Using Context Variables with Talend – Part 4

Pick up some tips and tricks with Context Variables

Blog

Talend API Services Publish to Talend Cloud

Learn how to publish your API Services to Talend Cloud

Watch Now