If you only want the free apps, take a look here:
Read the steps carefully as the order in which you follow them is critical. Note that you can do this only when creating a new Apple ID. You cannot use an existing ID.
You will of course not be able to get anything other than the free content without entering in some sort of payment method (credit card, prepaid iTunes card, gift certificate, etc.)