One Star

How to insert huge flat file -> CLOB column table

Hello,
I'm trying to insert big files (> 1GB) into a CLOB column of my Oracle table.
I did it by using internal "stringbuffer" variable types...
Now, I'm stuck because I get "out-of-memory : Java heap space" when the file is too big (failure when the file is bigger than 200Mb). It's not a solution for me to extend -Xmx VM parameters to very high values...
Is there a way to have the same result by saving memory somewhere (kind of of CLOB inserting in streaming ?).
Thanks a lot for your feedback,
François,
3 REPLIES
Seventeen Stars

Re: How to insert huge flat file -> CLOB column table

Currently not unfortunately but I have in the near future the same problem and start currently building a component for it. A component for Oracle what especially writes CLOB and BLOB. It is actually not a big deal but must be done.
One Star

Re: How to insert huge flat file -> CLOB column table

Thanks for you reply... Can you stayed in touch with us when you will develop the component...
In the meantime, does someone already have another solution ? I'm stuck -Smiley Sad
François,
Four Stars

Re: How to insert huge flat file -> CLOB column table

Hello Francois,
You can create a routine to copy the file as stream into the database. Map that routing using Map component.
Regards
Gopa