Import CSV file with Duplicates, While using unique indexes?

[Taf]

Does anyone know how you can import a CSV file or any delimited text file into a table which has unique indexes? The text file may have duplicate values contained and I need it to ignore these, not create an error import nothing! Any help would be appreciated, thanks.

 

[foxdev]

One approach is to import into a staging or temp table first, then select distinct from it and insert into your final table. Robert Bradley

http://www.lowcostprints.com

http://www.foxdev.com/

http://www.agrainofhope.org

 

[Adita]

You can use DTS but yo have to specify that you use unique index.

 

[tfierens]

Thanks for these answers, but when I run the DTS Wizard, it throughs up errors??

Any idea on how to increase the number of errors allowed?

Regards,

Thierry

 

[tlbroadbent]

In Enterprise Manager, open the DTS package and double click the transformation that is copying the text file to SQL Server. Click on the Advanced tab. There you can set the Max error count and designate an Exception file name.

You must also turn off the Fast Load option. Terry

http://members.home.net/tlbroadbent/index.htm

 

[hughed00]

I use a 2 step import, import into a SQL DB with Unique Index and Ignore Duplicates turned on. This throws away the duplicates. Then you can import into a DB with a defined Primary Key Index because you won't have any duplicates.