Cursor jump from Safari to Yahoo browser while typing

When I open up Safari, I usually will type something into the URL bar of Safari, but because I have Yahoo as my homepage, the cursor will jump from the Safari URL bar to the yahoo search box. It usually does this as I'm typing mid sentence, right after I load up Safari. Is there any way to stop the cursor from jumping from Safari to Yahoo automatically? Does anyone know what I'm talking about? This is kind of annoying.

Google Chrome doesn't seem to do this... or it is because possibly that Chrome loads up quicker. So if Yahoo.com is my homepage and I open Google Chrome, I click into the (Chrome) URL and the cursor won't jump to the Yahoo search box, like it does in Safari. It might be because Chrome loads up the yahoo page quicker so there is no chance for it to jump, but I'm not completely sure that's the case.

I'm thinking of just permanently switching to Chrome because there doesn't seem to be setting to stop this in Safari.