Only draw, unable to scroll with Apple pencil on my Files

as usual, when editing a pdf on Notes or My Files apps I could use my apple pencil to scroll or zoom while at the same time drawing. Now even when ‘only draw with apple pencil’ mode is off , on Files app, while editing a pdf or a photo as soon as my apple pencil touches the screen I cant scroll instead they automatically draw lines aswell. Is there a solution for this? its so frustrating….