One Star

Writing a component creation tutorial

Hello all,
in the last few months I gathered a bit of experience in creating component,s so I thought it might be useful to others to (try to) summarize what I learnt.
I wrote the first part of the tutorial, you can find it here, I just went through the basic concepts so far, but indeed I may expand to more advanced ones if someone finds it useful.
The page can be found here : http://www.powerupbi.com/talend/componentCreation_1.html
Please feel free to send remarks, suggestions etc.

  • Exchange components
32 REPLIES
Community Manager

Re: Writing a component creation tutorial

Hi
Great work! Thank you saburo, I had a looked at your website and saw that you do a great contribution to open source and Talend.

Best regards
Shong
----------------------------------------------------------
Talend | Data Agility for Modern Business
One Star

Re: Writing a component creation tutorial

Thanks Shong.
I posted the second part of the tutorial, tonight I will start writing the next one.
The url is here : http://powerupbi.com/talend/componentCreation_2.html
One Star

Re: Writing a component creation tutorial

Hello all,
part 3 of the tutorial is out :
http://www.powerupbi.com/talend/componentCreation_3.html
Sorry you will have to be patient for part 4, as I will be traveling starting today for about one week.

Best regards,
Francesco
Community Manager

Re: Writing a component creation tutorial

Hello all,
part 3 of the tutorial is out :
http://www.powerupbi.com/talend/componentCreation_3.html
Sorry you will have to be patient for part 4, as I will be traveling starting today for about one week.

Best regards,
Francesco

ah,
yes, have a good trip!
Best regards
Shong
----------------------------------------------------------
Talend | Data Agility for Modern Business
One Star

Re: Writing a component creation tutorial

Hello, I just posted part 4 of the tutorial, you can find it here :
http://powerupbi.com/talend/componentCreation_4.html
One Star

Re: Writing a component creation tutorial

good..
One Star

Re: Writing a component creation tutorial

Hello part 5 is out here : http://www.powerupbi.com/talend/componentCreation_5.html
I am currently writing part 6 and planning to release it this week.
Topics covered so far :
Lesson 1 : Component basics - Templates and java output code
Lesson 2 : The three parts of a components
Lesson 3 : Component files, the XML descriptor
Lesson 4 : Working with the java jet templates
Lesson 5 : Component parameters
Lesson 6 : (Planned for release this week) Working with data connectors
One Star

Re: Writing a component creation tutorial

Hello, part 6 of the tutorial is out, it covers the basics concepts about connectors which will be further developed in part 7 (which will focus on schema, metadata associated to connections).
Part 6 can be found here :
http://powerupbi.com/talend/componentCreation_6.html
Part 7 will be released next week.
One Star

Re: Writing a component creation tutorial

Hello, as promised, part 7 is out ( here http://powerupbi.com/talend/componentCreation_7.html ).
In this lesson I guide the reader in the creation of a CSV input component.
Part 8 will focus instead on output components, we will create one of them.
Also, with a processing component (has both input and output) we will show how it is possible to output less records than the ones in input.
I would be happy to receive some honest feedback from you so I can adjust accordingly for the next lessons.
One Star

Re: Writing a component creation tutorial

Hello, part 8 of the tutorial is out here : http://powerupbi.com/talend/componentCreation_8.html
In this lesson I guide the reader in the creation of an output component (that writes an xml file with metadata and records that it receives from the input connection).
I would like to thank all those who sent their feedback, as a general rule, feel free to contact me should you have questions.
One Star

Re: Writing a component creation tutorial

Hello again,
part 9 of the tutorial is out, it covers the case of a component that outputs a number of records lower than the ones it receives in input.
The page can be found here : http://powerupbi.com/talend/componentCreation_9.html
The code of the component created in the tutorial is downloadable at that address as well.
Best Regards
One Star

Re: Writing a component creation tutorial

Hello, I just released lesson 10 of the tutorial.
This quite a "special" one, because in this lesson I do some reverse engineering of an existing component (tFileInputJSON) to fulfill a request posted in this thread : http://www.talendforge.org/forum/viewtopic.php?pid=66200#p66200
So this lesson explains how to modify an existing component, by adding the "die on error" functionality.
I was not able to test the modified component yet, so it is totally possible there are few mistakes here and there, however I hope someone of you could try it out and eventually correct where I made mistakes.
I explained every single modification I made, so shoudl not be difficult Smiley Happy
Ah, the link is here ; http://powerupbi.com/talend/componentCreation_10.html
Community Manager

Re: Writing a component creation tutorial

Dear Saburo
You have finished so much work! Thank you for your patience and persistence.Smiley Wink
Best regards
Shong
----------------------------------------------------------
Talend | Data Agility for Modern Business
One Star

Re: Writing a component creation tutorial

Thanks, I may add a few more lessons in the future, but I believe those I already released should cover pretty much what's needed to get started.
If anyone has specific request I may consider them for new lessons.
Also feel free to post questions and comments, as usual.
Bye.
One Star

Re: Writing a component creation tutorial

Thanks a lot Saburo !!!!!
One Star mpa
One Star

Re: Writing a component creation tutorial

Started reading your tutorial! Very interesting man!
Thanks a lot for your effort! :-)

Regards
Employee

Re: Writing a component creation tutorial

Hi,
Thanks to a Team member, I discovered this thread and the very good contributions Saburo was able to make.
As this is a very interesting forum thread, that can benefit to all the Community, I've "stickied" it (a request from the Team member - thanks a lot Imad!) on the Component creation forum.
Thanks for your contributions Saburo!
Best,
Pcoffre.
One Star

Re: Writing a component creation tutorial

Wow, I am honoured to be "stuck" there Smiley Happy
I might add a few more articles in the future, will keep announcing them here should it be the case.
Employee

Re: Writing a component creation tutorial

That's great, thanks again for your contributions saburo!
Best,
Pcoffre.
One Star

Re: Writing a component creation tutorial

Hello, I have been busy with other things for quite some time, but I received some feedback on my tutorial, so I decided to add another lesson here : http://powerupbi.com/talend/componentCreation_11.html
It's about component design methodology and debugging.
I am not sure it's a proper methodology or approach, it simply kind of works for me, so I though I might share it.
Happy coding!
One Star

Re: Writing a component creation tutorial

Hi
That's so great. Thanks for your work. Smiley Happy
Regards,
Pedro
One Star

Re: Writing a component creation tutorial

Hello everybody,
I noticed my tutorial is quite used lately (I hope it proves useful), but I also noticed that many coders jump into component creation (which is cool, don't stop!) disregarding routines.
Sometimes routines can provide a simpler, cleaner solution to many tasks, so I decided to create a tutorial on this topic, it can be found here :
http://powerupbi.com/talend/routinesCreation_1.html
I know there are already some good tutorials around on the subject, but I wanted to highlight the differences with components when it comes to coding.
Regards,
Francesco
One Star

Re: Writing a component creation tutorial

Hi Francesco,
Really amazing work... Thanks a lot for helping all of us to get started...
--
Vinod
One Star

Re: Writing a component creation tutorial

Hi Francesco!
Great Tuto! It's a good approach for beginning of component building.
Well done guy!
Xavier
One Star

Re: Writing a component creation tutorial

Hi Francesco,
Really amazing work... Thanks a lot for helping all of us to get started...
One Star

Re: Writing a component creation tutorial

Hi Frn..
thanks , it works well as required... We are new to talend , hope we learn more and contribute more !
One Star

Re: Writing a component creation tutorial

Hi!
I must say that your tutorial is awesome! I like your way of writing, especially your sense of humor Smiley Happy
I can hardly wait next parts...
btw. Say hello to your sleepy cat Smiley Wink
Best regards,
Lady Butterfly
Seventeen Stars

Re: Writing a component creation tutorial

I would prefer if Talend could set free a space in the wiki and we write a tutorial in a wiki. This would allow more developers to contribute to the tutorial.
One Star

Re: Writing a component creation tutorial

Hi Everyone
These tutorials got me up and running very quickly.
Thanks so much for them.
There is one aspect of component creation that still alludes me ...... Creating a component that multiplies output.
In tutorial 8 it states "there is a specific methodology for them"
However I have not been able to find this written up anywhere on the web.
If anyone can point me in the right direction and get me going I would happily blog on it for everyone.
Thanks in advance
Phil