Metronome out of sync during playback

I record a guitar to a click track. When I play it back it's out of sync. It is not consistent though. it's like two different tempos and its hard to tell which one is slower; the click or the recorded Track. Does anyone have experience with this?