How can I stop AirTag tracking notifications?

So I set up an AirTag with my phone and was using it for about 2 months. Then, all of a sudden I went to check on it in find my but it said it couldn’t connect even though I was holding it in my hand. I started receiving notifications that there was an AirTag following me around LITERALLY EVERYWHERE I go, so it must be the one I keep in my wallet. Any ideas how I could fix this?

[Re-Titled by Moderator]