Well see if this clears the Safari cache. You can remove items from favorites and they should never show up again.
Close Safari completely from the multitasking window by double clicking the Home button and swiping up the Safari preview pane all the way up until it disappears from the screen. You may have to look for the pane by swiping side to side as there may be several there. Then go to Settings > Safari > Clear History and Website Data. Then do a hard reboot. Hold down the Home and Wake/Sleep buttons at the same time for about 15-20 seconds until the Apple logo appears. Ignore the "Slide to power off" text if it comes up. You will not lose anything.