What version of Pages?
Generally you have to divide the document with Section Breaks so the page is a Section by itself.
Do that by click at the bottom of the prior page > Menu > Insert > Section Break
Do that again at the foot of the actual page.
Menu > View > Show Thumbnails > click on the page thumbnail > Delete
Unfortunately, neither approach works. If you select the page in page thumbnails and hit 'delete' everything goes. And creating sections to delete between does not want to work either. Sad that such a simple thing - deleting a page - is beyond this program. And yes, I was stupid and 'upgraded' to Pages 5.2.