Does it search for a driver every time that the PC is turned on?
If you use COM ports? Well, the COM ports are these DB9 connectors (shaped like the parallel port but with just 9 pins instead of 25). Some PCs don't even have these ports on the back plate these days, as they are virtually not used anomore. So if you don't, then go in the BIOS menus. You should find a submenu called something like peripherals, or integrated peripherals, where you would see some info on these ports. You would have the choice of assigning an address or interrupt line, or to disable it. Disable it.
Moving your USB2 card to another PCI slot, will also change the interrupt lines and the problem may disappear by doing so. It sounds like snake oil, but this is one of the limitations of the PC architecture, that dates back to the early 80s, and to stay "PC-compatible" this limitation is still there.