apple tv remote volume control keeps defaulting to "auto (off)"

Every once in a while (but at least once a day) my AppleTV remote (4k 1st gen, running tvOS 17.0) will stop controlling the volume to my surround sound speakers. When I go into the settings, (Settings > Remotes and Devices > Volume Control) it has switched itself to "Auto (off)". All of my learned devices are still there. If I choose one from the list it works perfectly. Until the AppleTV randomly decides to go back to "auto (off)". I think this happened in the recent update (only been a few weeks). But it's very annoying when a movie or show starts and is SUPER loud and suddenly I can't control the volume anymore! I've noticed it doing this when the device went to sleep, or I switch apps, but it's not consistently happening at those times so I can't really say either of them are the cause (sometimes it happens in the middle of a show/movie).