How to remove loating keyboard/dictation icon?

Hello,

I have a 11" iPad Pro with Magic Keyboard.

How do you remove the floating keyboard/dictation icon in the lower right corner of the screen?

It interferes with my text input (see screenshot of iMessage example).

I use the globe key to access emoji, so I would like to completely remove this icon.

I found you can tap and drag the floating icon to the other side of the screen, but this reverts back to the lower right corner the next time a text input field is brought up.