Migration of 2000 Ms-SQL-Server Tables to Cassandra

Highlighted
Seven Stars

Migration of 2000 Ms-SQL-Server Tables to Cassandra

Hi,
We have a requirement to migrate around 2000 tables from SQL server to Cassandra(Big Data) Database.
The jobs are simple in which SQL server table will be mapped to a Cassandra table.
There is no complex logic. Its just copying data from one table(in SQL SERVER) to another table (in Cassandra)
SQL_SERVER_TABLE_1------------>Cassandra_Table_1 and so on..
So for 2000 tables in SQL Server we have to create 2000 jobs to copy data into Cassandra.
can you please suggest some automation so that we can save time of creating 2000 jobs manually?
P.S: Note that in Cassandra a table is called a 'column family'. For the sake of clarity I have mentioned it as table.
Thanks
Tom
Moderator

Re: Migration of 2000 Ms-SQL-Server Tables to Cassandra

Hi,
Are your 2000 tables same schema structure?
So far, tCassandraOutput don't support for "Dynamic Schema" feature.
Best regards
Sabrina
--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
One Star

Re: Migration of 2000 Ms-SQL-Server Tables to Cassandra

Hi xdshi,
We have a query regarding the above scenario which was raised by Tom.
Lets suppose we have Source with Schema1 and Target with Schema2. And target table structures are same as Source table structures.
But each tables are different from each other structurally. Our requirement is to load all the 2000 target tables with single or less number of jobs.
Please advise this can be done or not.
Thanks
Moderator

Re: Migration of 2000 Ms-SQL-Server Tables to Cassandra

Hi,
So far, talend big data components don't support for dynamic schema.
Best regards
Sabrina
--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Best Practices for Using Context Variables with Talend – Part 4

Pick up some tips and tricks with Context Variables

Blog

How Media Organizations Achieved Success with Data Integration

Learn how media organizations have achieved success with Data Integration

Read

6 Ways to Start Utilizing Machine Learning with Amazon We Services and Talend

Look at6 ways to start utilizing Machine Learning with Amazon We Services and Talend

Blog

Why Companies Move to the Cloud: 7 Success Stories

Learn how and why companies are moving to the Cloud

Read Now