Alright. I'd do this in safe mode because with the troubles you've been having, it's the best bet.
Somewhere, most likely C:\NVIDIA, you should have the NVIDIA folder with the latest driver extracted because you already tried to install from it. It extracts to this folder by default.
Alrighy then.
Use Driver Sweeper one more time to get rid of everything like I said, in safe mode. The reboot to safe mode.
Open device manager. Right click on the video card which should probably say "Generic" at this point.
Choose update driver software. Browse my computer. Let me pick... Have disk.... Browse. Now find and double click on the nv_disp.inf that is a few folders deep in C:\NVIDIA.
Hit ok and then hit next and it will install.
When done, boot to normal mode and see how it goes.