How to change active/default audio "device" without rebooting

I recently updated my NVIDIA card with audio drivers and now it can make the audio go through my television using HDMI (watching videos). The problem however, is that when I go into the Sound settings and change the default to the NVIDIA "device", I need to reboot windows to activate the change. I have tried going into the mixer and the sound setting and I can't figure out a way to change the active audio device without having to reboot (or even just log out and log back in).

Is there a menu or option I am missing?

And to be clear, Even when I change the default device the audio mixer (and just the volume adjuster when clicking on the volume icon in the notification tray) still show the device icon as being the audio speakers, not the HDMI device icon (that only happens after the reboot).

This website is not affiliated, owned, or endorsed by Microsoft Corporation. It is a member of the Microsoft Partner Program.