I think I have this one figured out. I had set up a Bluetooth headset with microphone. Even though the headset was not connected, it seems it was holding the stereo output from the normal 5.1 output.
I removed the device and the front speaker output came back.