Your situation indeed sounds unusual and I can tell you're quite frustrated. From what you've described, it seems like you've covered all bases: graphics card, motherboard, PSU, and different PCIe slots. The consistent issue is when you plug in your new RTX 4070 into the first PCIe slot.
Based on the error codes you're getting, it seems as though you're experiencing issues usually related to your GPUs or other connected hardware.
Error 116 can suggest graphic card instability while error 124 is often related to hardware causing system instability. However, since your computer works fine using the other graphics card or the RTX in another computer, we can't necessarily say that the graphics card is defective.
As for the WHEA Logger...