Just so we are straight, since you never mentioned the name of the icon, it doesn't say desktop.ini, does it?
If you search your user folder, does the icon show up?
Before you go to the trouble of reinstalling, try a repair install.
If it was downloaded, maybe you could clear out all of IEs temporary files.