Read/Extract Data Mainframe

Highlighted
One Star

Read/Extract Data Mainframe

Hi,
I just wonder how do i wants to extract data from mainframe?
I got the data as text file that do not contain any delimiter? Is there any way Talend can handle this matter?
Plz help me Smiley Sad

Rgds,
Kal
Moderator

Re: Read/Extract Data Mainframe

Hi,
So your problem is how to extra data from text file that do not contain any delimiter? I have designed a demo job as follows:
id name
1 shong
2 sabrina
tfileinputdelimited-->tLogrow
Is that what you need? Or Is your file fixed_length?
Would you give us an example of your source file(without delimiter)
see pics
Best regards
Sabrina
--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
One Star

Re: Read/Extract Data Mainframe

Hi Sabrina,
I'm not sure that is accurate resolution since i received encoded data that contain of number in the whole file like '321900000000000003000000440300' and i need to break it accurately so that this encoded data can be translated properly.
According to user they retrieve info from mainframe (not sure what it is) and convert it into textfile with encoded info and that's why nobody can understand the info and only after translate it back to analog.
I'm personally hard to explain.... Smiley Sad

Regards,
Kal
Moderator

Re: Read/Extract Data Mainframe

Hi,
The info about your requirement is a little for us. Would you get more info from user? Do you mean the data "321900000000000003000000440300" is ASCII? and encoding it into UTF8 or others? Need your confirmation.
Best regards
Sabrina
--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
One Star

Re: Read/Extract Data Mainframe

Hi Sabrina,
I am Kal colleague. The data is in ASCII code.
You have any idea on that?
Regards,
Omie
Moderator

Re: Read/Extract Data Mainframe

Hi,
What is your expected result? Encoding the ASCII code into what type? I think we can support encoding ASCII code in Talend.
Best regards
Sabrina
--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
One Star

Re: Read/Extract Data Mainframe

Hi,
Our expected result is to translate it to readable text. Talend can do so?
Regards,
Omie
Moderator

Re: Read/Extract Data Mainframe

Hi,
I have designed a demo job using component tChangefileEncoding and converting "ASCII" into "UTF-8". The result is "3.219E+29". Is it the readable test you mentioned? What's more, you can use "Custom" option to custom which type you want.
Best regards
Sabrina
--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
One Star

Re: Read/Extract Data Mainframe

Hi Sabrina,
I try already but the output is still same data in code view.
Regards,
Omie
Moderator

Re: Read/Extract Data Mainframe

Hi,
Would you mind sending your screenshot on the forum, just like what i give to you in #8, and i need take a look in your job.
Best regards
Sabrina
--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
One Star

Re: Read/Extract Data Mainframe

Hi Sabrina,
I give you my sample data picture 1,
and my job picture 2
Regards,
Omie
Moderator

Re: Read/Extract Data Mainframe

Hi,
Well, it is too small to see........
Best regards
Sabrina
--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
One Star

Re: Read/Extract Data Mainframe

Hi Sabrina,
Now you can see the image?
Regards,
Omie
Moderator

Re: Read/Extract Data Mainframe

Hi,
Not yet, can you see it in the forum? Well, you can send me a e-mail with these screenshots, which will be better.
Best regards
Sabrina
--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
One Star

Re: Read/Extract Data Mainframe

Hi,
I attached once again the images. Capture1 is output, capture2 is input, and capture3 is the configuration.

Rgds,
Kal
Moderator

Re: Read/Extract Data Mainframe

Hi,
I have noticed that, and please check the "Use Custom Input Encoding" item. The component tchangeFileEncoding will read your system type by default. You need change it into your type "ASCII".
Best regards
Sabrina
--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
One Star

Re: Read/Extract Data Mainframe

Hi,
I also noticed that, these images produced by myself. If you refer to Omie's images, she've done exactly what you asked me to do now, the result still same...just like mine. Also, i've selected to the other type, still got the same output.
Regards,
Kal
Moderator

Re: Read/Extract Data Mainframe

Hi,
I think we make a misunderstanding on your issue. i have consulted my leader and he said you don't really need to encoding your file but just want to get a readable text. I have known your requirement, using Talend to transfer the source file you got into readable text. Would you give some example, about the readable text? what exactly it look like? or tell us how do you get the source file, so that we can use the related component to help you. I don't think the Encoding is what you need. Because i have said it is the "3.219E+29" in 6#, which is not a readable text. Sorry for the inconvenient.
Best regards
Sabrina
--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
One Star

Re: Read/Extract Data Mainframe

Hi,
This file is sample file from user and they said that the data has been retrieve from mainframe and they converted into delimiter file. I require to translate it and load it into target. Readable text means i wants to translate it.
Rgds,
Kal
One Star

Re: Read/Extract Data Mainframe

If this is mainframe data you need to know what the original encoding was (EBCDIC?) and what the output encoding is. I don't recognise the output as any obvious encoding. It would be useful if you could get a copy of the original before it was encoded so you know what you're trying to create.
It looks like it's a lot of mainframe fields for numeric data probably 8 characters each. They don't translate directly to text items. I've seen stuff like this years ago but would need to know what the original was to remind me of how to translate it.
Five Stars

Re: Read/Extract Data Mainframe

if it is EBCDIC file then you can verify it using hex mode, open file in Hex mode and then send attached the screen shot i think this will help others to give you solution. another way is use Cobol copy book to parse the EBCDIC file with component named as EBCDIC file input.
One more thing changing Encoding of EBCDIC file will not work you have to parse it then transfer it readable format
One Star

Re: Read/Extract Data Mainframe

Hi All,
Thanks for your support. I just met the user and they said it is no need to translate it. However, they need to break that code into respective size of characters.
Is it possible for me to break it into each sizes and is Talend able to read the size and break it based on size defined in excel file?
Meaning that, there are 2 files provided. 1st file is text file containing code extracted from mainframe and 2nd file is excel file contain of size needed to break the code inside text file. I used tFileInputPositional to break it size per sizes.
regards,
Kal
Moderator

Re: Read/Extract Data Mainframe

Hi,
I used tFileInputPositional to break it size per sizes.

I agree with you that tFileInputPositional is a suitable component for your requirement. It can break your resource file into each sizes.
Best regards
Sabrina
--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
One Star

Re: Read/Extract Data Mainframe

Hi,
Indeed, but if i put the sizes in excel file and then i wants my ETL job to read the excel file with sizes and then set it up automatically to tFileInputPositional the sizes to break the resource files without manually set the sizes on it...is it possible?

Regards,
Kal
Moderator

Re: Read/Extract Data Mainframe

Hi,
i wants my ETL job to read the excel file with sizes and then set it up automatically to tFileInputPositional the sizes to break the resource files without manually set the sizes

It is possible to do that. Using tContextload-->tFileInputPositional. Please see the related technology article from Talend Help Center https://help.talend.com/search/all?query=tContextLoad&content-lang=en
Best regards
Sabrina
--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
One Star

Re: Read/Extract Data Mainframe

According to user they retrieve info from mainframe (not sure what it is) and convert it into textfile with encoded info and that's why nobody can understand the info and only after translate it back to analog.
One Star

Re: Read/Extract Data Mainframe

If the user can't tell you what the data is then there is no way you can construct it.
The data looks like a string of value fields. You need to know the length of each field and use tFileInputPositional to split it up.