I tried to drag my recycle bin to the taskbar without success.. just right click on the desktop and go to personalize and that should let you change what's on your desktop. if you right click the libraries link(which is just windows explorer) you can go to unpin.
NARF! that IS a problem isn't it lol.. did you try just hitting "use default settings"? if, of course you haven't changed anything else in that window..... that MIGHT work, other than that... i've been spewing pure BS for the last half hour