Subscription cancelled third party still charging

I cancelled an app subscription and my apple account is showing "cancelled", there are no charges from apple or receipts from apple but I am still being charged for the service directly from the third party. How do I get it to stop and get a refund?