Delay the fn/globe emoji pop-up (not general key delay, nor disable)

I use the FN button a lot, but I apparently press it a fraction of a second earlier than apple expects me to with other buttons. A lot of applications I use require either backspace or F buttons. I also like the emoji keyboard.

How do I delay the emoji pop up?

I don't want to change 'key repeat' or 'delay until repeat'.

Is there a terminal code to change this manually, or another way to change this? It is incredibly frustrating, and my fingers haven't adapted to the FN/globe button time frame.