From your Safari menu bar click Safari > Preferences then select the Passwords tab.
Select the finance website then click Remove.
Now open Keychain Access located in HD > Applications > Utilities
Select Passwords on the left.
Type in the name of the finance website in the search field top right corner of that window. If there's a keychain available, right or control click the keychain then click Delete.