Clicking Sound with Haptics Off and Silent Mode On
I found a resolution to the issue... If you have your phone connected to an audio device via bluetooth, the clicking sound will always be active when you long press hold on apps and notifications even with haptics turned off and silent mode active. To stop the clicking sound, turn off your bluetooth.
iPhone XR, iOS 16