Apple Mail app sending messages to spam even though spam filterering is disabled.

I have a gmail account connected to apple mail on my mac. I recently noticed all messages from a colleague were going to my spam folder. When I open the message in gmail spam folder it says I moved the messages there:

Of course I didn't do this, so I figured a connected app was doing it on my behalf. After disconnecting the gmail account from Apple Mail, the problem went away and all messages came to my inbox correctly. As soon as I reconnected the account, his messages started getting sent to spam again.

This makes no sense as I have turned off spam filtering in Apple Mail:

I've also checked and I have no rules set up in the app:

I doubt anyone is going to have a solution for this other than apple mail developer but I wanted to report the issue in case anyone else is having it.

(For reference the sending domain has SPF setup but not DKIM or DMARC, but regardless apple should not be marking messages as spam if i turned off spam filtering in the app.)

My OS is currently Sequoia but I noticed the issue first on Sonoma.