Turn off Markup when using Apple Pencil

In iOS 12 when I would use Apple Pencil on a PDF saved in FILES it would just start writing and not open Markup. Now in iOS 13 when I start writing with Apple Pencil Markup opens too so any swipes or movement with my finger ALSO draws on the PDF. This is very annoying as I use PDF files in FILES every day and I need to make notes and scroll through the document back to back. Now I either have to turn off Markup every time I want to scroll or I have to use 2 fingers to scroll. Either option is very annoying and time consuming because I am constantly making accidental marks and having to go back and fix them.

Is there a way to turn off Markup so it does not automatically come on?

iPad Pro 11"

Apple Pencil 2

iOS 13.1.3