Click start button
All programs
Accessories
Right Click Windows Explorer and choose properties
Copy and paste this into the target path
%SystemRoot%\explorer.exe /n,::{450D8FBA-AD25-11D0-98A8-0800361B1103}
Click OK.
NOTE: This has no impact on the "Libraries" link that is typically pinned to the taskbar.
If you want it to work simalarly you'll need to right click that link and choose pin to taskbar.