How to remove a page number from a specific page

I am editing a poetry book in pages and my document starts with a title page followed by a couple of blank pages followed by table of contents pages followed by the rest of the book pages. Now I have page numbering set up in the footer with the option of 'not visible on the first page'.

My problem is, I want to remove the page number from the those blank pages following the title page, but keep the numbering going after that. However, if I try to delete the page number from the specific page footer, it deletes it from all the subsequent footers (or alternating page footers.)

So, my title page is number 1, but selected as 'not showing on first page' it doesn't show the number, which works. Then, page 2 and 3 are blank, page 4 is the first page of table of contents, etc. I want to make pages 2 and 3 not show the footer/number, but keep page 4 and onward.

Thanks in advance!