Which banking apps? Bank Of America, ING Direct, AMEX, Discover, Fidelity - all work for me with 4.2.1 on my 3Gs.
Have you checked AT&T's forums to see if others are having issues with their mobile banking app? It would seem odd to me that other, standalone banking apps work fine with the update and only AT&T's mobile app was fubar'd, but stranger things have happened.