MacBook Air 2020 intel core i3 retina making buzzing noise with fan off

Hello community, I have had my MacBook Air 2020 for a couple months and I was fully aware of the overheating issues. So, I got a cooling pad and made sure to keep the MacBook Air off of pillows and my bed. However, no matter what I do, the computer still heats up very fast when I am opening safari and other web browsers or joining teams meetings. Since this was a common issue with the MacBook Air 2020 models and I have AppleCare +, I decided to ignore it. Recently today, I put my computer up to my ear to see if the fan is going and its not, but I hear a weird faint buzzing sound coming from the middle of the computer above the keyboard. Is this normal? Or should I be worried? I'm new to a MacBook Air so I don't know. Also the computer is NOT plugged in, my screen brightness was at half, and my keyboard backlight was off. Thanks for all replies!