Migration of 2000 Ms-SQL-Server Tables to Cassandra

Seven Stars

Migration of 2000 Ms-SQL-Server Tables to Cassandra

Hi,
We have a requirement to migrate around 2000 tables from SQL server to Cassandra(Big Data) Database.
The jobs are simple in which SQL server table will be mapped to a Cassandra table.
There is no complex logic. Its just copying data from one table(in SQL SERVER) to another table (in Cassandra)
SQL_SERVER_TABLE_1------------>Cassandra_Table_1 and so on..
So for 2000 tables in SQL Server we have to create 2000 jobs to copy data into Cassandra.
can you please suggest some automation so that we can save time of creating 2000 jobs manually?
P.S: Note that in Cassandra a table is called a 'column family'. For the sake of clarity I have mentioned it as table.
Thanks
Tom
Moderator

Re: Migration of 2000 Ms-SQL-Server Tables to Cassandra

Hi,
Are your 2000 tables same schema structure?
So far, tCassandraOutput don't support for "Dynamic Schema" feature.
Best regards
Sabrina
--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
One Star

Re: Migration of 2000 Ms-SQL-Server Tables to Cassandra

Hi xdshi,
We have a query regarding the above scenario which was raised by Tom.
Lets suppose we have Source with Schema1 and Target with Schema2. And target table structures are same as Source table structures.
But each tables are different from each other structurally. Our requirement is to load all the 2000 target tables with single or less number of jobs.
Please advise this can be done or not.
Thanks
Moderator

Re: Migration of 2000 Ms-SQL-Server Tables to Cassandra

Hi,
So far, talend big data components don't support for dynamic schema.
Best regards
Sabrina
--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.