Netezza External Tables

One Star

Netezza External Tables

Hi
I am trying to extract data from Netezza DB using external table concept using tNetezzaRow/tNetezzaInput component and it is giving Out of space exception after 1 Gb of extract or it will extract only 1 Gb of data and job still be in RUN status.
So, I had to use tNetezzaInput component and Dynamic Datatype(The reason to use Dynamic datatype is to extract any table) to extract data. But that is very slow. Can some one help me what I am doing wrong and where I can make changes to make external table concept work? If not External table is there any way i can extract data much faster. Now I am getting output like 1Gb per Hr.
I am using Talend 4.1.1
Code:
"CREATE EXTERNAL TABLE 'xyz.dat'
USING
(
DELIMITER ','
QUOTEDVALUE 'DOUBLE'
Y2BASE 2000
ENCODING 'internal'
REMOTESOURCE 'JDBC'
ESCAPECHAR '\'
)
AS
SELECT *
FROM xyz;"
One Star

Re: Netezza External Tables

Hi
You mean outofspace or OutOfMemory exception?
Please show us the sceen shot of your job. Then we may know where to optimize it.
Regards,
Pedro
One Star

Re: Netezza External Tables

I am sorry. Yes, OutOfMemory exception.
I attached my Talend snap shot.
One Star

Re: Netezza External Tables

Here is the snap shot.
One Star

Re: Netezza External Tables

Hi
Please increase the JVM arguements as the following image.
Regarda,
Pedro
One Star

Re: Netezza External Tables

HI Pedro
I did increase the JVM arguments and got the error. If I take it as 1024 it will extract data of 1 Gb and then keeps quiet and then I increased the size and it either craps out with an error "OutOfMemory" exception or it will extract 1 Gb data and does nothing(it neither dies or increase the file struncture)
One Star

Re: Netezza External Tables

Hi
I try to find out some components in your job which can support "store on disk" feature. But none support it.
So increasing JVM arguments is an effective way.
Besides, please select the option Advanced Settings->Use cursor on tNetezzaInput.
Regards,
Pedro