E-mails taking very long time to send...is it my yahoo server?

I updated to the ios 5 last week and have nothing but issues. Now my email through the mail app is taking forever (20 min) to send. I use yahoo and I went and checked all the settings. added an extra outgoing server and checked and double checked passwords....why is it taking so long to send. This is really bothersome! Is this a yahoo problem or apple problem???