Are you syncing the photos to iCloud? If so, if you delete a photo on the phone, it should delete from iCloud. Take a photo just for the sake of taking one, allow it time to sync to iCloud, and then delete it. Go to iCloud.com/Photos using a computer and see if it is deleted.
If you aren't syncing with iCloud, the photos are part of your backup.