New Air Tag Still Chirping with Battery Removed

I have a brand-new Apple Air Tag that I suspect is defective. I activated it and used it in my luggage once. I have taken all the steps to stop the chirping to no avail and now it is continuing to chirp even after I have removed the battery from the device. Has anyone experienced this? It is driving me nuts.