Hi ,
I have new requirements with me here which shows around 300 tables in a 10G database that have to go into a warehouse (another 10G DB to be designed). All ETL will be done by informatica since the databases are geographically separated and each one cannot access the other.
Now i want to have a one time initial load of all the current data in the source system and after that, i want to load only the data that has changed ( incremental refresh only).
In the prior databases this exclusively depended on Last_Update columns in each tables - the system would look at last data-load-time, compare it with the last-update time in the tables and choose only the columns that were changed since the last refresh.
The source system doesnt have these last update columns.
On doing some snooping around , i found Oracle 10G has features we can utilize for this - features which help us recognize which rows were changed since last refresh etc without having a specific Last-Update column added in each one of the 300 tables.
Can anyone shed some light on this for me?
From what i have read , it looks like the databases ( source and destination ) need to be able to communicate between each other for this feature to work ( streams , advanced-queues etc) - since my 2 databases cant talk to each other , can i have an alternative?
PS: I dont care abt deleted rows - only inserted ones and updated ones.
Thanks!
Regards,
S. Jayaram Uparna .
I have new requirements with me here which shows around 300 tables in a 10G database that have to go into a warehouse (another 10G DB to be designed). All ETL will be done by informatica since the databases are geographically separated and each one cannot access the other.
Now i want to have a one time initial load of all the current data in the source system and after that, i want to load only the data that has changed ( incremental refresh only).
In the prior databases this exclusively depended on Last_Update columns in each tables - the system would look at last data-load-time, compare it with the last-update time in the tables and choose only the columns that were changed since the last refresh.
The source system doesnt have these last update columns.
On doing some snooping around , i found Oracle 10G has features we can utilize for this - features which help us recognize which rows were changed since last refresh etc without having a specific Last-Update column added in each one of the 300 tables.
Can anyone shed some light on this for me?
From what i have read , it looks like the databases ( source and destination ) need to be able to communicate between each other for this feature to work ( streams , advanced-queues etc) - since my 2 databases cant talk to each other , can i have an alternative?
PS: I dont care abt deleted rows - only inserted ones and updated ones.
Thanks!
Regards,
S. Jayaram Uparna .
