iOS Photos offloading every photo to iCloud

For last couple of days my iPhone has started offloading every single photo to iCloud. This is happeninging even though I have 12GB of free space left on the device. This is really annoying as it takes up to 30 seconds to load each photo when browsing through them. Of course, videos take even longer. I don't have enough capacity on my device to hold my entire photos library so I appreciate the offloading feature but it would make more sense to only offload old items and only when the device is actually running out of space. Is there a fix for this?