Why is Apple not allowing any card to be used for paying, in India?
Paying by credit and debit card in the App Store / iTunes Store is subject to government and banking regulations in each country. It is currently not available in India and there is no point discussing it here.
There are plenty of platforms in India where you can talk about it.
We are also users of Apple products & services like you.
-----
Why must I set up and use UPI to make any transactions on Apple Store?
You can use Apple Account balance to make transactions on Apple Store
See -> About billing for Apple subscriptions and media products in India
About billing for Apple subscriptions and media products in India - Apple Support
See -> Payment methods you can use with your Apple ID
Payment methods you can use with your Apple ID – Apple Support (UK)
India
• Apple Account balance (from adding funds)
• Net Banking (adding funds only)
• UPI (adding funds only)
You can use / pay with your Apple Account balance, see: Add money to your Apple Account balance
Add money to your Apple Account balance – Apple Support (UK)