It's not uncommon for apps and their data to be stored in different location on your drive. As you've discovered, this makes getting rid of all the pieces difficult. Some apps will have an uninstaller utility that can eliminate most of this junk, but it's not always guaranteed. Fortunately, the stuff that's left behind usually doesn't take up much storage space, but it can still be annoying to know it's still there.
This separation of app and data can be helpful when one is updating an app or troubleshooting and might need to uninstall/reinstall that app. Reinstalling an application's data can be tedious and time consuming.
There are some third party apps that can help. Find Any File (FAF) is one app available in the App Store that you can use to search for remnants of uninstalled applications. Use it to search for files based on the application name or the developer, then delete those files.
A word of caution when using these utilities. When dealing with an application like Word, which shares resources with other Microsoft apps, deleting other files might impact the performance of any of those other MS applications. The same goes for Adobe apps and many games that are a part of a suite.
Sometimes it's best to simply ignore and live with the potential clutter until you have an opportunity to wipe your drive.