Streaming Input Component Talend DI Job

Highlighted
One Star

Streaming Input Component Talend DI Job

Hi,

 

I am building a custom streaming RabbitMQ input component to put in a Data Integration job and am having some problems with it behaving as it is still batching; aka it stops when I don't have a message.  When I created the component through the Talend Component Kit (1.1.19), I set it to streaming and the following entry is in my Mapper class ...

 

Infinite.jpg

 

 

So, following the docs, it leads you to your local config file.  Where is the local config file?  The docs point towards setting that in the Java code itself instead of reading off the file, can someone give a simple example of how to do that; I know it is like @Config("value").  Can I just put that in a method somewhere that gets called?

 

Also can you run a streaming input component in a DI job, or does this need to go in a Big Data job because DI jobs really don't support streaming inputs?

 

https://talend.github.io/component-runtime/main/1.1.19/component-implementing-streaming.html

https://talend.github.io/component-runtime/main/1.1.19/services-built-in.html#_localconfiguration

 

Thanks,

 

Jason

 

 

 

2019 GARTNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now