Voice Memo Syncing

Is there a way to manually sync voice memos from Apple Watch to iPhone? I use them for work and it helps to be able to listen, view, and edit. But every single time I record via my watch, I have to unpair and re-pair to my phone in order to sync voice memos.

Just to clarify, my OS is up to date, my watch is basically new, and my phone is an iPhone X.

Is there a fix for this? It takes a long time to unpair/re-pair and it’s really getting on my nerves!