Look here first C:\Users\(user name)\AppData\Roaming\Microsoft\Internet Explorer\Quick Launch\Taskbar Pinned\StartMenu
If it is in there delete it. If NOT Go onto the next stage.
1. Open the Start Menu.
2. In the search box, type regedit and press Enter. (See screenshot below)
3. In regedit, go to: (See screenshot below)
HKEY_CURRENT_USER\Software\Microsoft\Windows\CurrentVersion\Explorer\StartPage
4. In the right pane, right click on Favorites and click on Delete.
NOTE: The long binary number for the Favorites Data value is the list of pinned items. Since it cannot be easily edited, deleting it will be easier to reset it.
5. Click on Yes to confirm the deletion.
6. Close regedit and restart the computer.
This should undo the icon...