Apple pay shipping details - how to exclude "shipping address"

We enabled "detailed request to capture, customer number, email and shipping address, as shown here:

It parses following data to capture the details:

however some customers are not able to proceed as they do not have the "address" entered for payment:

is there a way to just ask the "contact number" and "email" rather than asking for those also the address, as i am assuming not all customers have added "address", but phone and email is mandatory?

so customers who do not have added address can also pay.