Lately,. most installers ask if you want to set it for all users or just the person installing it.
Go to C:\user\theirusername\desktop
Well, you can access their desktop from your account and you could delete the icons on the desktop.
As for the Start Menu that;s very tricky.
Would you like me to walk you through it?