Delete Gmail Archive Folder

I have several Gmail accounts which I receive mail through Apple Mail. For some reason, there are "Archive" folders for each account which I am not able to delete. When I try, I receive an error message that says "The IMAP command 'DELETE' failed with server error: Internal folder cannot be deleted. (Failure)." I've attempted to update my Mail preferences to not store deleted items on the server but these archive folders really seem to be slowing down Mail and removing them would make me so relieved. Any advice is appreciated 🙂