For incremental loading, how do people track changes (inserts, updates, deletes) in tables that are used in multiple stars?
For example, source table A is the driving table for records in dimension table B, and is used in the calculation of a measurement (e.g. a sum or max) in fact C. Again, assume dimension B and fact C are not necessarily in the same star schema.
Now, say there is a change to table A. How do I make sure this change is reflected in both dimension table B and the measurement in fact C, while keeping the mechanism reliable and as simple as possible?
It is not viable to delete and reload either the dimensions or facts...it is important to only load the delta changes after the initial load.
Thanks for any help!
For example, source table A is the driving table for records in dimension table B, and is used in the calculation of a measurement (e.g. a sum or max) in fact C. Again, assume dimension B and fact C are not necessarily in the same star schema.
Now, say there is a change to table A. How do I make sure this change is reflected in both dimension table B and the measurement in fact C, while keeping the mechanism reliable and as simple as possible?
It is not viable to delete and reload either the dimensions or facts...it is important to only load the delta changes after the initial load.
Thanks for any help!