Cannot use Siri with the F5 key

On macOS Ventura when I press the key with the microphone on it, by default it activates Siri or dictation.

When I change the setting to use the function keys instead in the macOS settings the default it is inverted.

Now I have to press the Fn 🌎 key to access the function printed on the function keys.

This works as expected for all keys (e.g. brightness or volume) except for the key with the microphone (F5).

Fn 🌎 + F5 now now does nothing anymore.

How can keep the inverted the default behaviour of the function keys and still use the microphone (Fn 🌎 + F5 or similar) key for Siri and dictation?

Could this be a bug in MacOS Ventura?