Did I really fix my stuttering audio?

I've been getting intermittent stuttering audio while performing live. It doesn't start until I play a few minutes. It is usually associated with one track, sometimes 2. It can be on any kind of track - audio, recorded midi, live midi, Logic instrument, 3rd party instrument. I using the built in audio output to a PA. My i/o buffer was set to 512. I increased it to 1024 and I still had the problem. So for fun I set the buffer to 32 thinking that the sound would would glitch worse and sooner. Lo and behold - no stuttering. I've played for over an hour 2 days in a row no stuttering. It seems like I fixed it but this doesn't make any sense. I'm not convinced it's fixed. I gotta be sure because this is for live performance. After all this I also removed all the plug ins I don't need for performance. This probably helps but it seems the buffer set to 32 fixed it.

Logic Pro 10.7.2

OS 12.5.1 Mac Book Pro