performance between RegEx and TFileInputDelimited

One Star

performance between RegEx and TFileInputDelimited

I found that tFileInputRegex is better than a tFileInputDelimited to do a join.
i don't understand why it's better. Is it always true or not ?
Employee

Re: performance between RegEx and TFileInputDelimited

Hello,
Do you mean that tFileInputRegex is faster than tFileInputDelimited ?
Regular expressions are pretty fast, but it also depends on various proerty like options selected in your tFileInputDelimited, your keys, your data types and on your files.
You post seems interesting, what is the gap between the two jobs ?
Regards,
One Star

Re: performance between RegEx and TFileInputDelimited

i have same structure on two components and time is better for x4 with RegEx.
Employee

Re: performance between RegEx and TFileInputDelimited

With your regular expression, we can see that you don't use the CSV options.
This option is really time-consuming.
You should deactivate it to accelerate your tFileInputDelimited components.
Regards,
One Star

Re: performance between RegEx and TFileInputDelimited

I test without csv option and now job is done in 13 minutes (20 minutes before). It's better but not really very good because there's only 1 million lines.
Employee

Re: performance between RegEx and TFileInputDelimited

Can you post your final job ?