I just figured out the problem! In Settings > System > Tablet > Additional Tablet Settings, there's options for when not using tablet mode, and turning these off solved it. I don't remember touching any tablet settings, but they were turned on at some point.