Can you unpin them from the Taskbar and then delete?
You might check the following folder and see if it is listed and can be deleted from there.
%userprofile%\AppData\Roaming\Microsoft\Internet Explorer\Quick Launch\User Pinned\TaskBar
This is a hidden folder so you may need to set the folder options to be able to see it. Copy and pasting in the Explorer path window might work.