How to change the icon/preview of my file to the logo of the program used to open the file?

When I save a document onto my computer, the preview of that file is the logo of the program I use to open that file. For example, when I save an Excel spreadsheet, it comes up with the Excel logo/icon as the 'preview' of the file.

However, after a few seconds, the file automatically changes to an actual preview of the document itself (such as the one in the photo).

I don't want this preview of the actual document, I want to see the logo of the program instead. I can imagine there's a simple setting for this somewhere. Can somebody help me figure out how to permanently keep my Microsoft Excel logo on all of my Excel spreadsheets rather than an actual preview? I want the same thing to go with my Microsoft Word documents (but with the Microsoft Word logo of course), etc.