1. Plug the computer in by ethernet with wireless off.. if your computer is one of the later models missing this most important port, buy a thunderbolt to ethernet adapter.. they are cheap and absolutely necessary to your continued sanity.
2. Test speeds with ethernet and ethernet only on the main router.. If that is ISP supplied modem then remove all the devices.. do that anyway to find out your actual internet speed at the current time.. does it match your ISP provision??
3. With the standard setup you have.. plug the computer by ethernet firstly into the TC.. get a speed.. it should be near identical to the speed from the ISP modem.. then into the extreme.. by ethernet.. and test speed again.. here there can be a major drop in speed due to the wireless link..
Tell us the results of all these tests.
We need to determine if you have actual wireless issues or ISP/Internet/Connection issues.
From there we can study wireless..
Be assured.. Yosemite is bug heaven for network issues. You are not alone.. welcome to the club.