Dynamic Schema Pivoting to Key-Value Pairs

Say you have a list of tables, each with different structures. All you know is which field is the primary key for each table.

 

Use the attached Job to:

  • Iterate through your table list
  • Read each table using dynamic schema
  • Pivot to key-value pairs (plus original primary key and some row metadata)

This particular solution does the pivot whilst streaming data from the source, avoiding having to hold a large amount of data in memory or use an iteration per row.

 

dynamicPivot.JPG

 

Job is for version 6.4.1

Version history
Revision #:
4 of 4
Last update:
‎10-13-2017 02:54 PM
Updated by:
 
Labels (2)
Contributors