Mac Mail: How to prevent out-of-office reply infinite loop

I'm in the habit of sending myself e-minders to my own email. I'm leaving town and enabled my out-of-office reply and later sent myself a message and it created a continuous loop of replies that would have overwhelmed my inbox had I not caught it. Is there a way to avoid this? I set up rules saying only to reply if "From" did not include my email address but the loop still happened.

Thanks for your input!