Multiple billing for same purchase on 2 separate cards

I was relentlessly hounded by Apple that the card I was using with my Apple wallet or Apple Pay was about to expire even though it most certainly was not. I removed that card however and attached my new credit card and continued life as usual until today when I went to make my credit card payment and realized that since I believe the 19th of January (I added the new card December 30th so I may be mistaken on what date the dual charges started) I have been receiving the same charges on both cards and the both institutions have been paying Apple for the service when it should have only been billed to the newly added card and no longer even be able to bill directly to my checking account especially since I removed it as a payment method and it’s a completely different financial institution. How do I go about proving this and getting my money refunded to me? Apple refunded some fraudulent charges that my Ex and her son had racked up on my Apple ID and told me they would never help me out like that again because it was my fault they had access to my account even though I changed the password and finger print multiple times around that all happening.

long story even longer there was one subscription at that time that was missed and never got cancelled and they billed me like $5 a week for at least a year before I realized it and they told me that they would not refund it and if I did a charge back they would close my account permanently.

I am trying to avoid all of this happening and just want to get these double charges fixed. How is best to go about this?