I have exactly the same issue. Next to that my phone is lagging generally. Stuttering animations, which gets worst the emptier battery gets.
This is my first X series iPhone, read it happened to iPhone X with iOS 11 but assumed it would be gone with Xs and iOS 12.
Sadly enough, no.