Hello, I have an issue with the component taggregaterow. It takes too much memrory, and i would like to know if you have a tips about it. I import a big file with 3 columns: Customer - Household i need to check if i don't have a same Customer in different hosehold For that i use the taggregaterow then tmap with filter (see attach files) but that takes too much memory, and job is failed any idea to reduce the memory used? thanks a lot
Hello thanks for your reply, i don't have access to your article, same in using my talend Id How could i replace tmap component? In my job import file -> aggregate row -> tmap -> outputfile tmap make a filter,ow12.Count_household > 1, and export all customer_id having more than 1 household thank for your ideas
Hi, The reference is on Talend Help Center and you are welcome to use your forum ID or register a new account freely. In addition, for a large set of data, try to store the data on disk instead of memory on tMap. See my screenshot Best regards Sabrina
-- Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
Hi back, i just tried, and it the same, i still use more than 1024Mo of memory, and the job failed but in fact i think i have found, in replacing tmap by tuniqrow (using disk), i can chck if card is not use twice in different household thanks a lot for your time
Hi StephMich, You need to register to MyTalend (http://www.talend.com/user/register) to benefit from all Talend online resources, inclusing Talend Help Center (KB + full online documentaiton). This registration is free of charge. Elisa
Hello Elisa, I'm already register, but when i go to the forum, it tells i'm not register and i appear as Guest My id is Stefanem thanks for your help About my issue, i resolved the Tmap problem, in replacing it by a tuniqrow. But still have an issue with the taggregaterow to count the number of custmer_id per household and export it in sql table, it takes all the memory If you have an idea? thanks