Talend Job Redshiftrow Copy Command Error

Four Stars

Talend Job Redshiftrow Copy Command Error

Hi ,

 

Can anybody help me,while i am running talend job with copy command its throwing error like:

insufficient data left in message during my COPY from S3 to Redshift.

 

Can anybody help me.

 

 

Regards,

Prasanth

Forteen Stars

Re: Talend Job Redshiftrow Copy Command Error

why You still do not want check what redshift think about this?
https://docs.aws.amazon.com/redshift/latest/dg/r_STL_LOAD_ERRORS.html

 

just

select * from stl_load_errors order by starttime desc;

It can give You more information about error

Screen Shot 2018-02-21 at 20.06.28.png

Screen Shot 2018-02-21 at 20.07.42.png

-----------
Highlighted
Four Stars

Re: Redshift Copy Command Error

Thank you vapukov.

 

Now i am getting different error which is "extra columns found". while loading data into redshift from s3.

 

could you please help me.

 

Thank you.

Forteen Stars

Re: Redshift Copy Command Error


@PALIVELATalend wrote:

Thank you vapukov.

 

Now i am getting different error which is "extra columns found". while loading data into redshift from s3.

 

could you please help me.

 

Thank you.


answer already in Your question Smiley Happy

 

investigate Your data! it mean:

- data do not proper escaped

- one(few) of rows contain separator character in column value, like

  • this is somedata, about something
  • this is another ~ similar data

1st will be detected as 2 column with "," separator, 2nd with "~" separator

-----------

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Talend Cloud Developer Series - Introduction

The Talend Cloud Developer Series was created to give you a solid foundational understanding of Talend’s Cloud Integration Platform

Watch Now

Talend Cloud Available on Microsoft Azure

An integration platform-as-a-serviceto help enterprises collect, govern, transform, and share data from any data sources

Watch Now

Self-service Talend Migration: Moving from On-Premises to the Cloud

Move from On-Premises to the Cloud by following the advice of experts

Read Now