I have the same problem but it is worse
My mouse stops working and then I hear a device disconnecting. After the disconnect sound, the mouse works again. This goes on again and again over the course of my computing. I too have disconnected all the USB devices NOT connected directly to the computer, but nothing has yet helped. I do not see any changes within the USB Controllers.
In the Human Interface devices, there were 6 entries. When the mouse froze all but two USB Input devices disappeared. I deleted one of the two USB Input devices and the HID-compliant devices never came back. Later on the HID-compliant consumer control came back. They disappear when the mouse freezes.
This stuff is beyond my level of understanding. If someone could help me, it would be greatly appreciated!