Glitch in assistive access re contacts?

Using my own iphone (iphone 11 pro, ios17.2.1] I am experimenting with assistive access for the benefit of a friend who suffers from mild dementia.

The goal is to focus the phone on calls and texts.

The problem came up when I first set up assistive access with only manually selected contacts showing and then later exited assistive access to permit access to all contacts. Re-entering assistive access, the program persists in showing only the selected contacts, not the whole list. Tried several times and also rebooted the phone.

Not sure how to fix this. Is there something I am missing?

Many thanks