A while back, I updated my computer to the most recent windows version and for a while the pictures of the videos that I have on my computer used to show up, but now it just shows the picture of the program I use to play them.
Open file explorer (the yellow folder icon), click on View at the top then Options > 'Change folder and search options' and View again and uncheck the following, Apply, Ok