OK, so your Mac is recognized with the cable and you can get online, that's good.
You said that your Macbook connects "through airport to my comcast cable", but earlier you mentioned that you didn't have an Airport Express (router), so I'm a bit confused. The built-in airport card is not a router, it just enables the Mac to pick up a wireless signal from a router. Do you have a router?
If you do have a router (or intend to buy one), included instructions will tell you how to set it up. If it has a Mac compatible setup CD included, it's easy; some do not and you need to go online (again, follow their instructions) and set it up manually including entering any or all of your computer's MAC addresses - without these steps, the router will not recognize the computer.
As for the network adapter, a signal from any wireless b device will not have very far reaching coverage, so that could be why Comcast blamed it on the layout of your house. Most routers or adapters today are g and/or n enabled which is newer technology and gives you much better coverage/signal. I do not own a Linksys product, but browsed their support pages; unfortunately, they no longer list any wireless b adapters, but the instructions for their g and n enabled adapters would be a good source of information on how to configure your adapter and join a wireless network, so you might want to check their support page. In any case, you would need to first establish a wireless network in your home and for that you need a router.