First, I am sorry I cant be of any help but I am curious. Are you using the standard calculator app? Ive tried all the operations available and works fine for me. Are you US based? May be a region specific thing? Not to be difficult but I assume you've restated all the phones? Is there sufficient storage on them? I wonder if the calc app needs system memory to complete functions and you don't have enough. Of course you'd think at least someone in the family would not be maxed out on storage.
Just to level set, I have the 15 pro max with iOS 17.3 for personal use and iPhone 12 with 17.3 on my work phone. THough to be fair the work phone is really locked down so its possible you got a some application software update I didnt get.
I am intrigued since as you say all in your family have the same issue. I will totally follow this thread.