If you don't use these instructions when creating an account : Create an iTunes Store, App Store, or iBooks Store account without a credit card or other payment method - Apple Support
you will be prompted to enter payment details before you can download anything on the account. After entering valid payment details you should be able to remove them : Change or remove your Apple ID payment information in the iTunes Store - Apple Support