Conference Calling

Someone called me and I wanted to conference in another caller so I pressed the "add call" icon, dialed the number and when the person answered I pressed "merge calls" but the call didn't merge. What am I doing wrong or can't I add a caller to my existing call that I didn't originate? I have an X iphone. Thanks.