Logic Pro: MIDI sync / latency issue recording external keyboard audio

Hi All, 

I have a latency problem. 

First of all my gear: 

Imac 27" sequoia 15.7.7

Logic 12.2

Nord Stage 3

Emagic MT4 midi transmitter

Tascam model 12

I recorded a MIDI track with my Nord. 

There’s a lot of latency when playing it back.

I fixed that under Settings > Audio > General > Plug-in latency. (Settings: All. — “Playback Pre-roll” is on, “Low Latency Monitoring Mode” is on. Limit is 5 ms). 

Now here’s my problem: the moment I select my audio track to record the sound from the MIDI track, the MIDI track goes out of sync. If I select the MIDI track again, it goes back into sync. But how can I record the audio (and thus select the audio track) while keeping the MIDI track in sync? I only have this problem with a keyboard connected via MIDI, not with Logic’s built-in plug-in synths. 

Does anyone recognize this problem? How do I fix it?