iCloud folder files only icons

Files in my iCloud folder on my MacBook only appear as icons with an icon beside the name showing a cloud and a down arrow. So to access the file, I would have to click that icon for it to download to my MacBook. Problem is, there are hundreds of files and if I am not connected to Internet, I can't access the file, so how do I make iCloud sync so that the file is really there on my Mac all the time?

Google Drive has the same issue for me, but Dropbox does not. All the files in my Dropbox folder are there all the time.