Four Stars

MongoDB CDC with Oracle/Maria DB

Hi Guys,

 

I have an requirement to implement CDC from MongoDB to Oracle/Maria.Can we implement the same with Talend Big Data Integeration product? I read few documents that its supported in Talend Enterprise edition for few of the RDBMS. Needed to check if it will support NoSQL also(MongoDB)?

The answer will help me to go for licenses of Talend Big Data integeration product. If not , can you please suggest if any other ETL tool supports the same?

 

 

Thanks,

Ritu

  • Data Integration
Tags (2)
3 REPLIES
Community Manager

Re: MongoDB CDC with Oracle/Maria DB

Hi Ritu
MongoDB does not support CDC now.

Regards
Shong
----------------------------------------------------------
Talend | Data Agility for Modern Business
Four Stars

Re: MongoDB CDC with Oracle/Maria DB

Thanks Shong for quick reply.

Seven Stars

Re: MongoDB CDC with Oracle/Maria DB

the answer:

 

MongoDB does not support CDC now.

 

need read as 

 

Talend still does not support CDC now. (and it true not only for MongoDB)

 

It not mean Talend bad, it great. it mean just - no one tools on market not cover all customers needs.

But we are happy and can combine technologies for achieve result.

 

https://www.mongodb.com/blog/post/mongodb-and-data-streaming-implementing-a-mongodb-kafka-consumer  https://www.mongodb.com/blog/post/tailing-mongodb-oplog-sharded-clusters

https://www.confluent.io/product/connectors/

https://github.com/debezium/debezium   http://debezium.io

https://streamsets.com/documentation/datacollector/2.5.0.0/help/index.html#Origins/MongoDBOplog.html

 

You can found ideas how to create MongoDB CDC producer on a links above, than use Talend as Kafka Consumer.

 

I do not not test this with MongoDB, but have tests with MySQL and it work as I need.

-----------