Safari address bar suggestions change after down arrow

Problem:

1. I start typing a URL I regularly visit.
2. Suggestions appear. I hit the down arrow to select the full URL from the Top Hits.
3. Safari continues processing suggestions and the Top Hits change (along with my selection)
4. This all happens in a split second so I hit enter and end up on the wrong page.

I do this no less than ten times a day and it's absolutely infuriating. I have no idea why Safari continues to change the suggestions when you've started navigating through them with your arrow keys. I'm really glad they have finally implemented a unified address/search bar, but c'mon. If a user is navigating through suggestions, they are probably going towards one that suits their needs. No need to keep updating.

So my question is: has anyone else experienced this? What's the best workaround?