I am creating an SSIS package to remove duplicates from (currently) the persons table.
We have approx. 50 clients, each wanting to set their own paramenters for what they consider a viable match. So, example
Overall match: 60% Manual Review
Field Match (The following MUST add up to 100%)
Prefix: 2%
First Name: 20%
Middle Name 3%
Last Name 40%
Suffix 10%
SSN 15%
DOB 10%
Driver's License 0%
Mother's Maiden Name 0%
I am using the Fuzzy Lookup transformation component to do this. Will set the minimum similarity in the column relationships to reflect the column percentages above. And Transformation Editor Similarity will reflect the manual review percentage.
Since these values will be set by each client, I was planning to place them in a table, call them into the SSIS package and set them into Global Variables. Then, I want to be able to set the above mentioned similarity threshold values, programatically, using those Global Variables.
However, I have found out that the SSIS Fuzzy Lookup Transformation Component cannot be modified progromatically at run time. So, I am now looking for a Third Party Fuzzy Logic Component that will allow me to set it's similarity variables at runtime.
Anyone know of such a beast?
Thank you, Kris
We have approx. 50 clients, each wanting to set their own paramenters for what they consider a viable match. So, example
Overall match: 60% Manual Review
Field Match (The following MUST add up to 100%)
Prefix: 2%
First Name: 20%
Middle Name 3%
Last Name 40%
Suffix 10%
SSN 15%
DOB 10%
Driver's License 0%
Mother's Maiden Name 0%
I am using the Fuzzy Lookup transformation component to do this. Will set the minimum similarity in the column relationships to reflect the column percentages above. And Transformation Editor Similarity will reflect the manual review percentage.
Since these values will be set by each client, I was planning to place them in a table, call them into the SSIS package and set them into Global Variables. Then, I want to be able to set the above mentioned similarity threshold values, programatically, using those Global Variables.
However, I have found out that the SSIS Fuzzy Lookup Transformation Component cannot be modified progromatically at run time. So, I am now looking for a Third Party Fuzzy Logic Component that will allow me to set it's similarity variables at runtime.
Anyone know of such a beast?
Thank you, Kris