Safari keeps lowering YouTube video quality (safari 14.0.3)

I recently bought the macbook air m1, like 2 months ago, and it currently runs big Sur 11.2.3. I also have safari running at version 14.0.3. Every time I go on YouTube and I am about 5 minutes in on a video, it will lower the quality of the video from 1080p to around 480p. This only happens on safari and not chrome which I also have installed. Safari does not have any extensions either! Does anyone know why this is happening and how to fix it.