Data Volume

One Star

Data Volume

Dear Team,  
I have to export bulk data (approx 1 billion) from Cassandra 2.0.14 via Talend. While I am using CQL (SELECT or COPY ) on cqlsh, it gets timeout or Cassandra is not properly response.   Can it be exported via Talend BD ? I have tested it for 50,000 records and it is working fine.  but I am not sure about  bulk extraction.  Can anyone suggest  ?

Thanks,
Sunil 
Moderator

Re: Data Volume

Hi,
Could you please indicate what's build version you are using? open source or subscription version? What does your job design look like?
Bestn regards
Sabrina
--
Don't forget to give kudos when a reply is helpful and click Accept the solution when you think you're good with it.
One Star

Re: Data Volume

I am using Talend Big Data community version  6.2.1 and DSE  Cassandra 2.0.14 . Actually Biz is looking full data of Cassandra table in CSV files. but it is not possible using CQL (Select * from tablename) or COPY  command due huge data in Cassandra table.

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Introduction to Talend Open Studio for Data Quality

Find out about Talend Open Studio for Data Quality

Watch Now

Enabling Data Governance

Learn how to enable Data Governance

Watch Now

The Definitive Guide to Government Data Quality

Take a peek at the definitive guide to Government Data Quality

Read