Seperate sounds playing through headset and speakers?

When I'm on a skype conversation with soemone, only that will play through my headset; music will play through the speakers. When I end the conversation, music will return to my headset. I'm sure there is some setting that can fix this but I for the life of me cant find it.

This website is not affiliated, owned, or endorsed by Microsoft Corporation. It is a member of the Microsoft Partner Program.