Are you sure you have the jack pushed all the way into the port? It's a bit recessed. If so, take it to the store (make an appointment with a "genius" first, you can do that online http://www.apple.com/retail/geniusbar/)to see if it's a defective head set or phone. IF defective they will most likely replace it on the spot.