"Always on display" in iPhone 14 pro is being considered in screen time. How to fix this?

My screen time with iPhone 14 pro was showing a much higher time than the actual usage. It was showing usage even when I was driving (it wasn't connected to carplay). This usage was show as a grey bar on the screen time graph. I assumed that this was due to the "Always on display" so i turned it off. And i was correct: my screen time dropped significantly and the grey bars almost vanished.

I really want to have the always on display but it is quite annoying to get that recorded as screen time. Is there any fix to this?