About fans and fan noise in your Apple product - Apple Support
“Ambient temperature, the temperature outside the device, also plays a role in the fans' responsiveness. If the ambient temperature is high, the fans turn on sooner and run faster.”
“The surface your device rests on can block its vents, affecting fan behavior. If you use your device on a soft surface like a couch, pillow, bed, or your lap, its fans might run more. Using your device on a hard, flat surface like a table or desk is best for temperature control.”
“If the fans in your Mac run fast even when it isn't experiencing heavy usage and is properly ventilated, you might need to reset the System Management Controller (SMC) on your Mac. If you're experiencing this issue on an Apple TV 4K, Airport Extreme, or Airport Time Capsule, unplug the device, then plug it back in.”
So, official advise is to unplug the device from power, then plug it back in. I would say give it a minute or two before plugging back in.
If the issue persists, then contact Apple Support. Do a room temperature measurement near the device as well, for context.