Apple TV - Samsung Soundbar - Volume Control Problems

Hello all. When I adjust the volume using my soundbar it acts weird. It won't stay at the level I put it at. For example, if I put it on 60 for example, it will go down to 42 or something like that. The max volume is 100 on my soundbar. I'm using the soundbar remote.

If I use the Apple TV remote, the volume on my soundbar volume increases by 20 or 25. I can't fine tune the volume to the level I want.

When I'm on the home screen, my volume control is normal. But if I go to any app like Youtube or HBO Max and adjust the volume, it doesn't keep my setting.

1. I tried resetting both Apple TV and my soundbar
2. I made sure the Apple TV loud sounds suppression or whatever it's called is turned off
3. I changed audio format to 16 bit
4. I tried stereo mode in the menu
5. I tried the learn new remote thing.
6. I used my phone and watched Youtube/Prime/HBO connected to my soundbar, and the soundbar volume is completely normal. So I ruled out the soundbar as the cause.

I don't know what else to try, hoping someone experienced this or something similar and found a fix.