"Only Draw With Apple Pencil" mode for all apps compatible with annotations ?

Is there a hidden setting to allow an "Only Draw With Apple Pencil" mode when annotating documents from the Files annotation app ? Or even better from any app that uses the annotation tools, such as the Books app ?

On my iPad Pro 12.9 with iPadOS 13.1.2, the "Only Draw With Apple Pencil" setting for the

Notes app works well and is a great feature. It allows to draw annotations using the Apple Pencil, to scroll with your fingers, without any action needed to explicitly enter/quit annotation mode.

With iOS 12 I was also able to annotate PDFs directly from the Files app with the same behavior. However since iPadOS 13.1.2 the behaviour has changed, which is a pity as I constantly get unwanted lines drawn by my fingers when I try to scroll.

How can I fix this ? The iPad with the Apple Pencil and the "Only Draw With Apple Pencil" mode is a great tool to annotate documents without printing them, but it becomes cumbersome without that mode.