I'm having a bit of trouble with a lookup transformation
I'm importing a dataset and looking for new, updated, deleted records by comparing the import table with an existing table.
On a lookup transformation, I drag over the UserID (creating the line connection between the user ID fields in both data sources), then check the fields I wish to carry over in my next transformation (where I set the rules for nulls, etc).
The problem I'm seeing (and the SSIS error reporting leaves a lot to be desired) is that the incoming data has some duplicate keys.
For example, a user ID exists twice, as this particular user exists in multiple departments, and this is where I get the error when trying to execute the task.
Is there a way around this? Am I just not setting this up correctly?
Thanks.
I'm importing a dataset and looking for new, updated, deleted records by comparing the import table with an existing table.
On a lookup transformation, I drag over the UserID (creating the line connection between the user ID fields in both data sources), then check the fields I wish to carry over in my next transformation (where I set the rules for nulls, etc).
The problem I'm seeing (and the SSIS error reporting leaves a lot to be desired) is that the incoming data has some duplicate keys.
For example, a user ID exists twice, as this particular user exists in multiple departments, and this is where I get the error when trying to execute the task.
Is there a way around this? Am I just not setting this up correctly?
Thanks.