Cannot share iCloud calendar

I am trying to share my calendar with my brother who recently bought an iPhone. I already have four people shared on the calendar, but it won’t let me add him. I press "Add person", then "+" to choose from contacts, but most of the contacts are grayed out and can't be chosen. His contact cannot be selected and I don’t understand why. Is there some sort of hidden rule?