After establishing the Credit Card account (i.e. after you have made purchases), you can remove the credit card information by editing your payment info, choosing "None".
Settings>iTunes and App Stores>Apple ID>View Apple ID>Sign-in>Payment Information