Hi I am trying to extract data from Netezza DB using external table concept using tNetezzaRow/tNetezzaInput component and it is giving Out of space exception after 1 Gb of extract or it will extract only 1 Gb of data and job still be in RUN status. So, I had to use tNetezzaInput component and Dynamic Datatype(The reason to use Dynamic datatype is to extract any table) to extract data. But that is very slow. Can some one help me what I am doing wrong and where I can make changes to make external table concept work? If not External table is there any way i can extract data much faster. Now I am getting output like 1Gb per Hr. I am using Talend 4.1.1 Code: "CREATE EXTERNAL TABLE 'xyz.dat' USING ( DELIMITER ',' QUOTEDVALUE 'DOUBLE' Y2BASE 2000 ENCODING 'internal' REMOTESOURCE 'JDBC' ESCAPECHAR '\' ) AS SELECT * FROM xyz;"
HI Pedro I did increase the JVM arguments and got the error. If I take it as 1024 it will extract data of 1 Gb and then keeps quiet and then I increased the size and it either craps out with an error "OutOfMemory" exception or it will extract 1 Gb data and does nothing(it neither dies or increase the file struncture)
Hi I try to find out some components in your job which can support "store on disk" feature. But none support it. So increasing JVM arguments is an effective way. Besides, please select the option Advanced Settings->Use cursor on tNetezzaInput. Regards, Pedro