Upgrading from XP has to be a clean install, unless they have changed something recently...I assume your "Rolled Back" comment refers to an upgrade install...
Otherwise, you might try disabling the device prior to the install or uninstalling it so the install will not try to use the older drivers. Maybe even disable it in the bios.