Go to the Control Panel and open the "Taskbar and Start Menu". When the new window is open go to the "Start Menu" tab and deselect the "Store and display recently opened items in the Start Menu and the taskbar"
CCleaner can help you delete Windows Explorer history