My 2 year old accidentally downloaded an expensive Hayday app can I cancel the purchase and get a refund?

Apple is the only one that can answer that question.

Start here: expresslane.apple.com

Present your question to them.

Good luck.

Obviously, if you are going to allow a 2 year old to play with your iPad, you will need to set restrictions on app store purchases.