How do I stop Youtube app from constantly refreshing

Every time I watch a Youtube video in the Youtube app and go to check a notification I got real quick, when I go back to the app the video i was watching disappears. Even if I was only out of the app for maybe 30 seconds. It’s becoming really irritating because I have to go find the video again, and sit through the intro ad again. Other apps I use do not do this; what I’m doing is not interrupted.

I’m not sure if this is the solution but I turned off Background App Refresh for everything and it still does this. I looked through all the settings on the app itself and nothing seems to apply here. I’m not tech savvy so sorry if there’s something obvious I’m missing here. Is there anything I can do to solve this rather annoying issue?