Streaming queue into database / Job connect with Route ?

Four Stars

Streaming queue into database / Job connect with Route ?

Trying a PoC to get data from a RabbitMQ and write into database. I can get messages out of a Queue via Route into a file and a job insert data from file into DB. Is it possible to to connect them together? Or is there a way to implement this in either job or route alone?

Thanks!

TalendQueueToFile.PNGTalendFileToDB.PNG

Tags (1)

Accepted Solutions
Fifteen Stars TRF
Fifteen Stars

Re: Streaming queue into database / Job connect with Route ?

Maybe this link could help you (thank's to @vapukov for the original answer)


TRF

All Replies
Fifteen Stars TRF
Fifteen Stars

Re: Streaming queue into database / Job connect with Route ?

Maybe this link could help you (thank's to @vapukov for the original answer)


TRF
Seven Stars

Re: Streaming queue into database / Job connect with Route ?

Hi,

 

From CmessagingEndpoint1, you can trigger a onSubjob ok to the InputFile.

Is this what you meant?

or

 

You can use tHashOutput and tHashInput components Instead of files.

 

Cheers!

Four Stars

Re: Streaming queue into database / Job connect with Route ?

I was on that page when trying to get rabbitMQ to work, forgot about the thread has connection to DB as well. 

Added a cTalendJob to take care of db insert and it's now working. Thanks!

Cloud Free Trial

Try Talend Cloud free for 30 days.

Tutorial

Introduction to Talend Open Studio for Data Integration.

Definitive Guide to Data Integration

Practical steps to developing your data integration strategy.

Definitive Guide to Data Quality

Create systems and workflow to manage clean data ingestion and data transformation.