Everything feels unresponsive, laggy and animations are not smooth on a freshly installed MacBook Pro M1 running Big Sur

Hey guys,

I'm coming from a 2017 MacBookPro Dual core and currently switched to a M1 machine. The problem is that the whole navigation, animations and general feeling off the OS is kinda off. It's not like I'm getting beachballs all the time. But there seems like a noticeable delay to everything especially to mouse and keyboard. It's even more pronounced when using my Magic Mouse 2. Also animations and scrolling feels like everything is running at 20 FPS. I observed my Frames per QuartzDebug and the system is switching between 20-60 FPS the whole time. I don't know if this is expected behavior but it's no wonders everything feels laggy when the UI is displayed with 25 FPS most of the time. Also the mouse seems to be dragging behind the whole time which is really annoying.

I tried so many things for troubleshooting already. I installed a fresh version of BigSur two times. I kept away every USB-connection beside charging. It's no external program or software that is interfering as I tested this on a freshly installed OS with no third party applications. My CPU and GPU aren't at any point using up more than 50% of the resources available. I wrote somewhere that MacOS sometimes takes some time after a fresh installation to get everything setup and done. For example indexing everything and doing processes that aren't showing up in the activity monitor but I couldn't find any more detailed informations about that.

While the M1 is fast at loading things and performing tasks well - I feel like the resources which display the UI where set to an absolute minimum and for a person like me that likes a smooth operating system where you aren't constantly plagued with lags while scrolling or switching sites in launchpad this really frustrates and I kinda wonder why it's so hard to deliver a smooth user experience with machines that are labeled the fastest of them all. Why is there constant performance improvement when the UI is running at 25-40 FPS most of the time.

If anyone has an idea what this is all about then just tell me please. In my eyes its not acceptable to invest more then 1500 bucks into a device which then fails to deliver a lag free user experience while doing simple and basic tasks.