Say you have a list of tables, each with different structures. All you know is which field is the primary key for each table.
Use the attached Job to:
Iterate through your table list
Read each table using dynamic schema
Pivot to key-value pairs (plus original primary key and some row metadata)
This particular solution does the pivot whilst streaming data from the source, avoiding having to hold a large amount of data in memory or use an iteration per row.
Job is for version 6.4.1
... View more