Variation180
Programmer
Are there any limitations to the number of transformations that can be in a mapping? I'm using v5.1 to aggregate 300 million records by partition as follows:
1. Source Qualifier I'm using sql overide to aggregate based on table partition. Each partition returns approximatly 12 million aggregated rows.
2. Partition Router: The partition router has 25 outputs based on the partition being passed from the sql overide.
3. Target lookup: After the Partition Router has determined which partition is being loaded, the target caches a lookup to the target table based on the same partition logic to determine insert or update.
Overview: There are 25 sessions each filtered on a different partition from the target table. These all use the same mapping. Each session will take only one path from the router and perform one lookup to do insert or update to the target. Overall, there are 25 partition routers, 25 insert update routers, 50 update strategies and 50 target tables(same table).
Problem. I was able to run partitions 1 - 3 successfully and failed on session 4. I could not find any problems with the mapping for session for and attempted to rerun. The session produced the following message and would not start "Request to start session s_m_CMG_WH_CH_REDO_TBL_4 on server odsdev not successful." I can no longer run any of the sessions. I recreated the session from scratch and still receive the same message. All sessions and the mapping are valid. I parsed the sql overide from a command window and returned all data expected. Does anyone have any suggestions?
Thank you,
Chris
DB Programmer
Charlotte, NC
1. Source Qualifier I'm using sql overide to aggregate based on table partition. Each partition returns approximatly 12 million aggregated rows.
2. Partition Router: The partition router has 25 outputs based on the partition being passed from the sql overide.
3. Target lookup: After the Partition Router has determined which partition is being loaded, the target caches a lookup to the target table based on the same partition logic to determine insert or update.
Overview: There are 25 sessions each filtered on a different partition from the target table. These all use the same mapping. Each session will take only one path from the router and perform one lookup to do insert or update to the target. Overall, there are 25 partition routers, 25 insert update routers, 50 update strategies and 50 target tables(same table).
Problem. I was able to run partitions 1 - 3 successfully and failed on session 4. I could not find any problems with the mapping for session for and attempted to rerun. The session produced the following message and would not start "Request to start session s_m_CMG_WH_CH_REDO_TBL_4 on server odsdev not successful." I can no longer run any of the sessions. I recreated the session from scratch and still receive the same message. All sessions and the mapping are valid. I parsed the sql overide from a command window and returned all data expected. Does anyone have any suggestions?
Thank you,
Chris
DB Programmer
Charlotte, NC