Finally figured out how to do include custom folders, and remove the default windows ones as well:
Go to Start
Right click on Music and choose Properties
This gets you to the Library Folders UI, so it should be fairly straightforward. Just add/remove folders here and Media Player 12 updates...