[resolved] Delta load / Oracle

Highlighted
One Star

[resolved] Delta load / Oracle

Hi all,
hopefully to get an answer to my question, I'll try to describe my problem below:
I need to load the delta from a table to another table, quit simple... I thought...
All components, source and target, are tOracleInput and tOracleOutput. The source and target sample-data looks like this:
Source
--------
ID(sequence) somedata
1 data1
2 data2
3 data3
4 data4
5 data5

Target
--------
ID somedata talendPID
1 data1 asdf
2 data2 asdf
3 data3 qwer
4 data4 qwer

As you maybe assume, I need to load the source data entry 5 without overwriting the other lines in the target table. Using the standard component-options like 'action on data' (update) didn't work for me using a flow like this:
Source main......
\
tMap (left join) ---> tOracleOutput Target
Target lookup..../
A second problem could be the sequence in tMap, where I create the ID... just because I wasn't able to find a function for incrementing an ID for a table.

Version:
Talend Integration Suite - PE 4.1.2

Thank you for your posts!
Best regards

Accepted Solutions
One Star

Re: [resolved] Delta load / Oracle

Hi again,
just to complete this topic, attached you'll find a screenshot using a simple way of loading delta records in case you don't have any timestamps in your source.
Using tMap, create a left outer join to lookup your target, then just check if the target field is empty (null). And there you go!
Rgds
Ben

View solution in original post


All Replies
One Star

Re: [resolved] Delta load / Oracle

Any ideas?
One Star

Re: [resolved] Delta load / Oracle

Issue resolved!
Just in case you got the same issue, contact me via mail.
Employee

Re: [resolved] Delta load / Oracle

Thanks for the feedback tos_user.
Best,
Pcoffre.
One Star

Re: [resolved] Delta load / Oracle

This forum is for sharing. please put the brief about the solution that you have. thanks in advance.
One Star

Re: [resolved] Delta load / Oracle

Hi again,
just to complete this topic, attached you'll find a screenshot using a simple way of loading delta records in case you don't have any timestamps in your source.
Using tMap, create a left outer join to lookup your target, then just check if the target field is empty (null). And there you go!
Rgds
Ben

View solution in original post

Re: [resolved] Delta load / Oracle

sorry
but if your target has CUST_ID as an *incremental* integer - could you not find the max() and then filter your source using that?
One Star

Re: [resolved] Delta load / Oracle

Hi tis_user,
I have the same problem like you mentioned. But I can't see the attachment picture.
Can you give me some clue??

2019 GARNER MAGIC QUADRANT FOR DATA INTEGRATION TOOL

Talend named a Leader.

Get your copy

OPEN STUDIO FOR DATA INTEGRATION

Kickstart your first data integration and ETL projects.

Download now

What’s New for Talend Summer ’19

Watch the recorded webinar!

Watch Now

Best Practices for Using Context Variables with Talend – Part 2

Part 2 of a series on Context Variables

Blog

Best Practices for Using Context Variables with Talend – Part 1

Learn how to do cool things with Context Variables

Blog

Migrate Data from one Database to another with one Job using the Dynamic Schema

Find out how to migrate from one database to another using the Dynamic schema

Blog