Incremental updating file

One Star

Incremental updating file

hi all,
I have a job,it read data from MSSQL,and write the data to disk files, I want to incremental updating data,For example:

First write:
Name Age
test 28
Second write
Name Age
test 29
because the data is very large, so i don't want to delete the Original file, i just want the data can incremental updating when i write data
How can i do this?? Which component i can use?
One Star

Re: Incremental updating file

Hi
It's easy to do incremental inserting. Because you can simply record the last accomplished row number and store it for next time using.
But for incremental updating, there isn't an accurate way to do this. Especially your description is limited.
The most difficult thing is we don't know where to locate the update row.
Maybe I miss some details.
Regards,
Pedro
One Star

Re: Incremental updating file

Thanks for your answer,
i query the data first,write them to disk file, i query the data again, i hope i can incremental updating the data when i query data second,
for example: first name is test, age is 28, second, name is test,age is 29,
when i write data in disk file, the file stored value is test and 29
One Star

Re: Incremental updating file

Hi
Which type of disk file? I think it's impossible to do update. For delimited file or excel file, there are only 'append' and 'overwrite' two options.
Regards,
Pedro

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Best Practices for Using Context Variables with Talend – Part 1

Learn how to do cool things with Context Variables

Blog

Migrate Data from one Database to another with one Job using the Dynamic Schema

Find out how to migrate from one database to another using the Dynamic schema

Blog

Best Practices for Using Context Variables with Talend – Part 4

Pick up some tips and tricks with Context Variables

Blog