About brawal

brawal · ‎04-13-2018

Hi, I need to read the files under directories using tssh component. Any idea how could I do this please?

brawal · ‎04-09-2018

Did exactly same. It worked. Thanks a lot.

brawal · ‎04-09-2018

I was trying with replaceAll function to avoid "-". So you think I need to do on Variable ports? Could you please suggest me exactly what I need to mention as expression?

brawal · ‎04-09-2018

Hi, Attaching the screenshot. Please let me know if any questions.

brawal · ‎04-09-2018

Hi, I am getting error with just the filter ( row2.AdminPartyId.replaceAll("[-]","") ) and below is the error message; Error Line: 3791 Detail Message: Type mismatch: cannot convert from String to boolean

brawal · ‎04-09-2018

Hi, Please forget about the other filters. Now I only have row2.AdminPartyId.replaceAll("[-]","") Could you please help me getting rid of "-" character from AdminPartyId?

brawal · ‎04-09-2018

Hi, I tried your logic in tMap but it doesn't seem it is working. I am trying to avoid "-" from AdminPartyId and only want those values given for AdminSystemValue. I can get those values on AdminSystemValue with the logic I have but never for AdminPartyId.

brawal · ‎04-09-2018

Hi, as you see on screenshot other are the filters to get the data I like to have in output. Suppose row2.AdminSystemValue.equals("CR") pulls CR data and || is or character to add more filters. Above row2.AdminPartyId.replaceAll("[-]", "") is working and I get out as expected. When I put row2.AdminPartyId.replaceAll("[-]", "") then get that error shared.

brawal · ‎04-09-2018

Hi Boppudi, I am attaching the tmap expressions. Please let me know if any further questions.

brawal · ‎04-09-2018

Hi, Thanks for the response, it is not null pointer error. I get below error; Error Line: 3791 Detail Message: The operator || is undefined for the argument type(s) boolean, String

brawal · ‎04-09-2018

Hi, I have been trying to avoid the special character like 312328-342344 ("-") and have output as 312328342344 or even 312328 342344 but it is not happening. Can you please help me on this. I did try the following; row2.ColumnName.replaceAll("[-]", "") and more but it doesn't work, I keep getting error. This has a data type string by the way. Can somebody help on this?

brawal · ‎03-17-2018

Hi, I have number of folders and each folder has JSON files. I am trying to extract all the JSON files from each HDFS. For that I have used tHDFSList and tHDFSProperties to read files but I have been getting the below error message on tHDFSProperties; Error Line: 4018 Detail Message: md5 cannot be resolved or is not a field studio. Could you please let me know what is the issue?

brawal · ‎01-04-2018

Please let me know if you are not clear.

brawal · ‎12-26-2017

I have mentioned on the original post. The expression is as; Expression Type Variable TalendDate.parseDate("yyyy-MM-dd HH:mm:ss",row2.updatedtimestamp ) Date format_date TalendDate.parseDate("yyyy-MM-dd HH:mm:ss",TalendDate.getDate("yyyy-MM-dd HH:mm:ss")) Date Current_date TalendDate.diffDate(Var.Current_date,Var.format_date,"dd") == 126 ?true:false Boolean Out_Flag And screenshot;

brawal · ‎12-25-2017

Thanks for the input but that gets me bellow error; The method formatDate(String, Date) in the type TalendDate is not applicable for the arguments (String)

brawal · ‎12-25-2017

I did find out how to do tigger the jobs from TAC and so on. But thanks for that site.

brawal · ‎12-22-2017

I tried that. It gives following error. The method parseDate(String, String) in the type TalendDate is not applicable for the arguments (String, Date)

brawal · ‎12-22-2017

Hi Sabrina, Thank you for the input. I haven't created a case on talend support portal. Is there a section of this site I can go to create a case or somewhere. Could you pleas provide me where can I do that. While I am there I will mention the error details and all. Thanks

brawal · ‎12-21-2017

Hi, we are using Talend Studio 6.3.1 (Talend Real-time Big Data Platform ). I have been trying to follow the documentation for scheduling the jobs but doesn't help that much. Could somebody please connect to me and show it how it works would be great great help. Thanks & Appreciate your help

brawal · ‎12-21-2017

Sorry forgot to mention that. That error is at Var.format_date as the code. And the complete code to date_diff is as; Proff_tmp.diff_date = TalendDate .diffDate(Var.Current_date, Var.format_date, "dd");

brawal · ‎12-20-2017

Hi, I am trying to do the incremental load of XML files. I do have date column on yyyy-MM-dd HH:mm:ss which is row2.updatedtimestamp. On first row I am trying to convert my string type data to date format. On the second row I am trying to get the current time. On the third row I am doing the date differennce with the my date column (row2.updatedtimestamp) with flag. But the problem is that I am keep getting error as; Type mismatch: cannot convert from Date to String. Could you please let me know what is wrong? I also have shared the screenshot of job Expression Type Variable TalendDate.parseDate("yyyy-MM-dd HH:mm:ss",row2.updatedtimestamp ) Date format_date TalendDate.parseDate("yyyy-MM-dd HH:mm:ss",TalendDate.getDate("yyyy-MM-dd HH:mm:ss")) Date Current_date TalendDate.diffDate(Var.Current_date,Var.format_date,"dd") == 126 ?true:false Boolean Out_Flag

brawal · ‎11-29-2017

Yes it is of course working without Talend.

brawal · ‎11-24-2017

Talend doesn't support this option?

brawal · ‎11-22-2017

Hi Sabrina, For the performance concern I am trying to use this parallelization option. I want extract to be performed parallel so that extract would be fast. The other combination that I tried gets jobs running fine but data jumble issue is there. Suppose timestamp column captures data only for timestamp normally or without this option the way I have in screenshot. May be there is something wrong with the option I selected as screenshot, I don't know but I am getting data jumbled up. Data that doesn't belong to timestamp column is populating to timestamp column which is wrong. Could you please let me know, what is the issue?

brawal · ‎11-15-2017

I enabled the parallelization options on XML extract jobs that converts XML fields to pipe delimited text file. But it is causing data jumble. When I do partition and departition option jobs get stuck. What is the correct way to set partition and departition? Could you please suggest. I am sharing the job screenshot below:

brawal · ‎11-14-2017

So no one has idea to this? Or this is not supported in talend. Please let me know.

brawal · ‎11-14-2017

I found an alternative solution to this

brawal · ‎11-14-2017

Sorry I found a solution to this. Thanks for all the replies. Really appreciated.

brawal · ‎11-13-2017

Talend Studio version to this is 6.3.1 in case if anyone wants to know

brawal · ‎11-13-2017

This is because job running on standalone mode. I need to configure in yarn mode for queue.

brawal · ‎11-11-2017

Hi Talend community, I have been trying to filter the load with the timestamp filter on hbase with tHbaseInput component. I tried with different combination of input but it doesn't seem to be working. I am sharing the screenshot of hbase data and tHbaseInput's filter. Please let me know if any idea.

brawal · ‎11-10-2017

Thanks you for that correction. I see now data is not loaded at all. Is the logic wrong? If so can somebody please suggest me the fix?

brawal · ‎11-10-2017

Hi have XML field that I am extracting as one field and has timestamp of format (yyyy-MM-dd'T'HH:mm:ss.SSSSSS). Now I want to only get yyyy-MM-dd for the date comparison so that I can do the incremental load like ( yyy-MM-dd)<= 7 (for 7 days incremental). On my tjava I have: context.runDate=TalendDate.parseDate("yyyy-MM-dd","2017-07-03") On the tMap, Expression builder I have to change the format of the timestamp to yyyy-MM-dd : TalendDate.parseDate("yyyy-MM-dd",TalendDate.formatDate("yyyy-MM-dd",TalendDate.parseDate("yyyy-MM-dd'T'HH:mm:ss.SSSSSS",row2.timeStamp))) Then I have below logic for date compare: (TalendDate.compareDate(Var.datevalue,context.runDate,"yyyy-MM-dd"))<=1 When I run the job it runs fine but it doesn't load as logic but will load the entire data. Can somebody please help me on this.

brawal · ‎11-10-2017

6.3 version.

brawal · ‎11-09-2017

Hi, Data type is string. Originally it is on date on XML but due to parsing issue, I had to change it to string.

brawal · ‎11-09-2017

Hi, I have tMap component for the XML extract. For some of the column/attribute filter works fine but for one of the column/attribute it is not. Below is the filter condition. row2.timeStamp.equals("2017-07-06T06:35:00.000000") Could you please let me know if any issue?

brawal · ‎11-09-2017

So no solution to this?

brawal · ‎11-03-2017

No. Messages are correctly transferred however I don't see logs on Resource Manager on this. When we are extracting XML files and parsing/converting to Text (Pipe Delimited or other), there should be MapReduce process taken place for this. But I don't see this happening.

brawal · ‎11-02-2017

I posted the screenshot. Any idea to this? Anyone?? Any idea??

brawal · ‎10-27-2017

sure. Attaching along to this..

brawal · ‎10-24-2017

Hi, I have a job that extracts the XML files from Hbase in Hadoop and parse it to the pipe delimited text format file. So my question here is the MapReduce-queue is not used for this job although I see the pipe delimited data before completion of the data. Is there a case this happens in talend big data studio? Please let me know if any idea to this. My question is

brawal · ‎10-08-2017

Thanks Shong for the quick response. As the attached screenshot. <msg:telephones> tag has data one for fax and other for the telephone. Now since I am taking the xpath loop from different tag which locates next to telephones tag (otherProvLocId as the screenshot), then there is issue with telephone tags that second set/tags of data are missing. I did try to pull the telephones tag separately where I don't get missing data issue but then I have to join two different extracts where there is join issue because no primary key that ties two different extract. Now is there a solution to this without writing java code. Please let me know.

brawal · ‎10-06-2017

I have multiple nested XML structured file. I have kept loop path from one nested loop where there is no missing of data issue. But with other nested loop, it is only picking first element. I did try by separate extract for different nested but while joining tables (tables are the ones that created from XML extract) from separately extracted tables I am getting Cartesian product issue due to no proper primary key. Now in this issue can you please help me.

Date Registered	‎10-06-2017 10:29 PM
Date Last Visited	‎04-18-2018 04:57 PM
Total Messages Posted	43