Apple Card Being Declined

I recently switched to using my Apple Card but I am noticing that it is getting declined at some places. One of those places was Walmart where they do not accept Apple Pay so I had to use the physical card, ended up paying using my debit card. Yesterday I was a a restaurant, the transaction wouldn't go through with the card I had to hand over my phone for the cashier to walk away to the terminal to use Apple Pay. Same issue at a gas station, I had my wallet on me but had left my phone in the car, Apple Card wouldn't go through, had to go to the car to fetch the phone. If it keeps happening I'm thinking of reverting to my previous card.