It works as expected on my system.
Here is my two cents, feel free to ignore:
Are you playing the portion of the timeline where this problem occurs without rendering the section? If you render the audio and video, does the appearance of sync improve? It may be that your computer does not have sufficient horsepower to slow the video, slow and pitch shift the audio and play this all back correctly.
As a test, if you export that portion of the timeline to a file and play that exported file back in QuickTime Player, does the appearance of sync improve? This combines the speed adjusted elements into a easy to play file and serves as a way to see if it is the processing power of your computer.
Are you confident you can accurately determine the sync when viewing material that has be slowed to 20% of original speed? Detach the slowed audio from the slowed video, if you move the audio earlier or later in the timeline in small increments, can you achieve the appearance of the sync you expect?
Slowing material down that far will acerbate any sync relationship error in the original recording and the pitch shifting process may repeat may introduce a bit more, particularly if the timeline portion is not rendered.
An external microphone recording on a separate audio recorder opens up another can of worms unless you are using an audio recorder that is Timecode locked and synced to the video camera, as is done in professional workflows. Even with that equipment you might still encounter the appearance of an out of sync condition when using the material as you are planning on the timeline.
MtD