Talend failing against * WIDE * files - this is definetly a BUG

Talend failing against * WIDE * files - this is definetly a BUG

hi,
i am trying to create metadata for a file that contains around 500 columns.
it seems to have too many columns for Talend to handle.
Talend is just not able to create the metadata for it. the wizards fails with the 65365 limit in string length. which means that i can not preview the file - OK
but when i get to the metadata stage of the wizard, it does not manage to 'GUESS' the metadata for the file with error
guess failure
guess based on preview to step 2
> details
output not generated

any ideas on how to work around this BUG
the actuals file contains 4+ GB and it should have the following columns - the list below was given to me in Excel.
is there some way to past this into Talend?
Column_00 String(255)
Column_01 String(35)
Column_02 NUMBER
Column_03 NUMBER
Column_04 NUMBER
Column_05 NUMBER
Column_06 NUMBER
Column_07 String(3)
Column_08 String(20)
Column_09 NUMBER
Column_10 NUMBER
Column_11 String(3)
Column_12 NUMBER
Column_13 NUMBER
Column_14 String(100)
Column_15 String(10)
Column_16 String(12)
Column_17 String(10)
Column_18 String(10)
Column_19 Number(1)
Column_20 String(5)
Column_21 String(20)
Column_22 String(10)
YYYY-MM-DD
Column_23 String(10)
YYYY-MM-DD
Column_24 Number(2)
Column_25 Number(12)
Column_26 String(8)
Column_27 String(4)
Column_28 String(4)
Column_29 String(4)
Column_30 String(8)
Column_31 NUMBER
Column_32 NUMBER
Column_33 NUMBER
Column_34 NUMBER
Column_35 NUMBER
Column_36 String(4)
Column_37 String(4)
Column_38 NUMBER
Column_39 String(4)
Column_40 String(4)
Column_41 String(4)
Column_42 String(2)
Column_43 String(2)
Column_44 String(2)
Column_45 String(1)
Column_46 String(2)
Column_47 String(1)
Column_48 String(4)
Column_49 String(35)
Column_50 String(9)
Column_51 String(12)
Column_52 String(1)
Column_53 String(12)
Column_54 String(2)
Column_55 String(8)
Column_56 String(1)
Column_57 String(5)
Column_58 NUMBER
Column_59 String(2)
Column_60 String(35)
Column_61 String(35)
Column_62 String(9)
Column_63 String(9)
Column_64 String(12)
Column_65 String(1)
Column_66 String(1)
Column_67 String(12)
Column_68 String(12)
Column_69 String(1)
Column_70 String(17)
Column_71 String(2)
Column_72 String(2)
Column_73 String(1)
Column_74 String(2)
Column_75 String(2)
Column_76 String(1)
Column_77 String(2)
Column_78 String(1)
Column_79 String(2)
Column_80 String(8)
Column_81 String(10)
YYYY-MM-DD
Column_82 String(20)
Column_83 String(2)
Column_84 String(1)
Column_85 String(17)
Column_86 String(2)
Column_87 String(8)
Column_88 String(8)
Column_89 String(8)
Column_90 String(8)
Column_91 String(8)
Column_92 String(10)
YYYY-MM-DD
Column_93 NUMBER
Column_94 NUMBER
Column_95 String(1)
Column_96 String(1)
Column_97 String(1)
Column_98 String(1)
Column_99 String(1)
Column_100 String(8)
Column_101 String(8)
Column_102 String(8)
Column_103 String(6)
Column_104 String(10)
Column_105 String(17)
Column_106 String(17)
Column_107 String(12)
Column_108 String(12)
Column_109 String(12)
Column_110 String(5)
Column_111 String(12)
Column_112 String(12)
Column_113 String(12)
Column_114 String(12)
Column_115 boolean
Column_116 String(12)
Column_117 String(30)
Column_118 String(12)
Column_119 String(4)
Column_120 String(30)
Column_121 String(1)
Column_122 String(12)
Column_123 String(1)
Column_124 String(12)
Column_125 String(8)
Column_126 String(3)
Column_127 String(3)
Column_128 String(3)
Column_129 String(12)
Column_130 String(1)
Column_131 String(3)
Column_132 String(8)
Column_133 String(3)
Column_134 String(3)
Column_135 String(3)
Column_136 String(12)
Column_137 String(1)
Column_138 String(8)
Column_139 String(3)
Column_140 String(3)
Column_141 String(3)
Column_142 String(12)
Column_143 String(1)
Column_144 String(8)
Column_145 String(8)
Column_146 String(12)
Column_147 String(12)
Column_148 String(12)
Column_149 String(8)
Column_150 String(12)
Column_151 String(8)
Column_152 String(12)
Column_153 String(1)
Column_154 String(1)
Column_155 String(8)
Column_156 String(12)
Column_157 String(1)
Column_158 String(3)
Column_159 String(3)
Column_160 String(12)
Column_161 String(12)
Column_162 String(12)
Column_163 String(12)
Column_164 String(1)
Column_165 String(3)
Column_166 String(12)
Column_167 String(1)
Column_168 String(5)
Column_169 String(1)
Column_170 String(8)
Column_171 Number(5)
Column_172 Number(5)
Column_173 NUMBER
Column_174 NUMBER
Column_175 Number(5)
Column_176 Number(5)
Column_177 Number(5)
Column_178 String(6)
Column_179 String(6)
Column_180 String(7)
Column_181 String(7)
Column_182 String(22)
YYYY-MM-DD HH:MMSmiley FrustratedS:MS
Column_183 String(50)
Column_184 String(5)
Column_185 String(3)
Column_186 String(5)
Column_187 String(3)
Column_188 String(7)
Column_189 String(5)
Column_190 String(7)
Column_191 String(3)
Column_192 String(5)
Column_193 String(5)
Column_194 String(5)
Column_195 String(5)
Column_196 String(5)
Column_197 String(5)
Column_198 String(5)
Column_199 String(5)
Column_200 String(5)
Column_201 String(5)
Column_202 String(5)
Column_203 String(5)
Column_204 String (10)
Column_205 String(10)
Column_206 NUMBER
Column_207 NUMBER
Column_208 String(100)
Column_209 String (1)
Column_210 String(3)
Column_211 String(7)
Column_212 String(7)
Column_213 String(7)
Column_214 String(7)
Column_215 String(7)
Column_216 String(7)
Column_217 String(7)
Column_218 String(7)
Column_219 String(7)
Column_220 String(7)
Column_221 String(7)
Column_222 String(7)
Column_223 String(7)
Column_224 String(3)
Column_225 String(1)
Column_226 String(1)
Column_227 String(3)
Column_228 String(1)
Column_229 String(1)
Column_230 String(3)
Column_231 String(1)
Column_232 String(1)
Column_233 String(3)
Column_234 String(1)
Column_235 String(1)
Column_236 String(3)
Column_237 String(1)
Column_238 String(1)
Column_239 String(3)
Column_240 String(1)
Column_241 String(1)
Column_242 String(3)
Column_243 String(1)
Column_244 String(1)
Column_245 String(3)
Column_246 String(1)
Column_247 String(1)
Column_248 String(1)
Column_249 String(3)
Column_250 String(1)
Column_251 String(3)
Column_252 String(1)
Column_253 String(2)
Column_254 String(3)
Column_255 String(1)
Column_256 String(2)
Column_257 String(3)
Column_258 String(1)
Column_259 String(2)
Column_260 String(3)
Column_261 String(1)
Column_262 String(2)
Column_263 String(3)
Column_264 String(7)
Column_265 String(8)
Column_266 String(7)
Column_267 String(8)
Column_268 String(7)
Column_269 String(8)
Column_270 String(7)
Column_271 String(8)
Column_272 String(7)
Column_273 String(8)
Column_274 String(7)
Column_275 String(8)
Column_276 String(7)
Column_277 String(8)
Column_278 String(7)
Column_279 String(8)
Column_280 String(7)
Column_281 String(8)
Column_282 String(7)
Column_283 String(8)
Column_284 String(7)
Column_285 String(8)
Column_286 String(7)
Column_287 String(8)
Column_288 String(7)
Column_289 String(8)
Column_290 String(3)
Column_291 String(1)
Column_292 String(1)
Column_293 String(1)
Column_294 String(3)
Column_295 String(1)
Column_296 String(1)
Column_297 String(1)
Column_298 String(3)
Column_299 String(1)
Column_300 String(1)
Column_301 String(1)
Column_302 String(3)
Column_303 String(1)
Column_304 String(1)
Column_305 String(1)
Column_306 String(3)
Column_307 String(1)
Column_308 String(1)
Column_309 String(1)
Column_310 String(3)
Column_311 String(1)
Column_312 String(1)
Column_313 String(1)
Column_314 String(3)
Column_315 String(1)
Column_316 String(1)
Column_317 String(1)
Column_318 String(3)
Column_319 String(1)
Column_320 String(1)
Column_321 String(1)
Column_322 String(3)
Column_323 String(1)
Column_324 String(1)
Column_325 String(1)
Column_326 String(3)
Column_327 String(1)
Column_328 String(1)
Column_329 String(1)
Column_330 String(3)
Column_331 String(1)
Column_332 String(2)
Column_333 String(1)
Column_334 String(3)
Column_335 String(1)
Column_336 String(2)
Column_337 String(1)
Column_338 String(3)
Column_339 String(1)
Column_340 String(2)
Column_341 String(1)
Column_342 Number(5)
Column_343 Number(5)
Column_344 Number(5)
Column_345 Number(5)
Column_346 Number(5)
Column_347 Number(5)
Column_348 String(2)
Column_349 Number(5)
Column_350 Number(5)
Column_351 Number(5)
Column_352 Number(5)
Column_353 Number(5)
Column_354 Number(5)
Column_355 NUMBER
Column_356 NUMBER
Column_357 NUMBER
Column_358 NUMBER
Column_359 NUMBER
Column_360 NUMBER
Column_361 NUMBER
Column_362 NUMBER
Column_363 NUMBER
Column_364 NUMBER
Column_365 NUMBER
Column_366 NUMBER
Column_367 NUMBER
Column_368 NUMBER
Column_369 NUMBER
Column_370 NUMBER
Column_371 NUMBER
Column_372 NUMBER
Column_373 NUMBER
Column_374 NUMBER
Column_375 NUMBER
Column_376 NUMBER
Column_377 NUMBER
Column_378 NUMBER
Column_379 NUMBER
Column_380 NUMBER
Column_381 NUMBER
Column_382 String(8)
Column_383 String(5)
Column_384 NUMBER
Column_385 NUMBER
Column_386 NUMBER
Column_387 NUMBER
Column_388 NUMBER
Column_389 NUMBER
Column_390 NUMBER
Column_391 NUMBER
Column_392 String(10)
Column_393 NUMBER
Column_394 NUMBER
Column_395 String(3)
Column_396 String(1)
Column_397 String(1)
Column_398 String(3)
Column_399 String(2)
Column_400 NUMBER
Column_401 String(8)
Column_402 String(1)
Column_403 String(1)
Column_404 String(1)
Column_405 String(2)
Column_406 String(8)
Column_407 String(3)
Column_408 String(3)
Column_409 String(3)
Column_410 String(1)
Column_411 String(1)
Column_412 String(8)
Column_413 String(8)
Column_414 String(17)
Column_415 String(3)
Column_416 String(12)
Column_417 String(1)
Column_418 String(2)
Column_419 NUMBER
Column_420 NUMBER
Column_421 String(4)
Column_422 String(6)
Column_423 NUMBER
Column_424 String(4)
Column_425 String(4000)
Column_426 NUMBER
Column_427 String(8)
Column_428 String(50)
Column_429 String(5)
Column_430 NUMBER
Column_431 String(30)
Column_432 NUMBER
Column_433 String(8)
Column_434 NUMBER
Column_435 String(1)
Column_436 NUMBER
Column_437 String(8)
Column_438 NUMBER
Column_439 NUMBER
Column_440 String(1)
Column_441 String(14)
Column_442 String(8)
Column_443 String(8)
Column_444 String(8)
Column_445 String(3)
Column_446 String(8)
Column_447 NUMBER
Column_448 String(8)
Column_449 String(1)
Column_450 String(2)
Column_451 String(1)
Column_452 String(2)
Column_453 String(1)
Column_454 String(12)
Column_455 String(1)
Column_456 NUMBER
Column_457 NUMBER
Column_458 NUMBER
Column_459 String(1)
Column_460 String(1)
Column_461 NUMBER
Column_462 NUMBER
Column_463 String(1)
Column_464 NUMBER
Column_465 NUMBER
Column_466 NUMBER
Column_467 String(1)
Column_468 String(1)
Column_469 String(1)
Column_470 NUMBER
Column_471 NUMBER
Column_472 Number(5)
Column_473 Number(5)
Column_474 Number(5)
Column_475 Number(5)
Column_476 Number(5)
Column_477 NUMBER
Column_478 Number(5)
Column_479 String(12)
Column_480 String(8)
Column_481 String(3)
Column_482 String(35)
Column_483 String(8)
Column_484 String(8)
Column_485 String(8)
Column_486 String(8)
Column_487 String(1)
Column_488 String(8)
Column_489 String(20)
Column_490 String(20)
Column_491 String(6)
Column_492 String(16)
YYYYMMDDHHMISS
Column_493 String(50)

Re: Talend failing against * WIDE * files - this is definetly a BUG

bumping..
Six Stars

Re: Talend failing against * WIDE * files - this is definetly a BUG

known bug, issued in the forum many times
see
http://www.talendforge.org/bugs/view.php?id=6766
post your comments to the such bug tracker

Re: Talend failing against * WIDE * files - this is definetly a BUG

emaxt6
since i have no authority over the extracts produced.
how do i work with them since i can not split them?
thanks

Re: Talend failing against * WIDE * files - this is definetly a BUG

bumping..
Six Stars

Re: Talend failing against * WIDE * files - this is definetly a BUG

Nicolas,
talend is limited in the number of column it can handle (as an effect of java platform maximums it is subjected to) and yes this translate in a big problem for the product due to the number of big horizontal tables that are around in the market, especially in legacy environments.
So till the bug it is resolved it is a show stopper, you can track the bug instead of bumping; as an option you can: - choose another tool or - write custom code
bye

Re: Talend failing against * WIDE * files - this is definetly a BUG

thanks emax
it has actually become a show stopper for me (literally)
as my boss now has told me to use SSIS - as it just does it!!
a bit disapointing.
but i suppose it is nothing that i can do.
thanks,
Nicolas

Re: Talend failing against * WIDE * files - this is definetly a BUG

While this may not be possible in your situation-- you could use a Perl based job, it does not have this issue.
Six Stars

Re: Talend failing against * WIDE * files - this is definetly a BUG

thanks emax
it has actually become a show stopper for me (literally)
as my boss now has told me to use SSIS - as it just does it!!
a bit disapointing.
but i suppose it is nothing that i can do.
thanks,
Nicolas

Well SSIS is a good and recognized tool, so you won't regret the choice... anyway I know that can be very messy if you started a big project with talend and you need to use another tool for some parts. Or try a talend perl project if that it is allowed in your environment, as the other user suggested.
Anyway It must be said that Talend should state clearly the tool "maximums" in the documentation, for seriousness, because now it is a well known thing and not knowing it can make people lose a lot of time; people deserve to know that beforehand.
Seventeen Stars

Re: Talend failing against * WIDE * files - this is definetly a BUG

hi all,
ask for a feature !


regards
laurent

Re: Talend failing against * WIDE * files - this is definetly a BUG

Thanks for requesting for this to be included in the documentation.
it really is something that should be put on the first pages as it would probably help one define which language their project should be created under.
with regards,