Smart Groups in macOS Contacts still seems super buggy

Even after updating to macOS 10.15.4, Smart Groups in Contacts is still super buggy or inconsistent for me. I currently have 2 standard groups labeled Family and Friends respectfully. I wanted to create a Smart Group labeled Unsorted that would contain all contact cards not located in my Family and Friends groups. So, I created the following rules: (1) Contains cards which match all of the following conditions, (2) Card is not a member of group Family, (3) Card is not a member of group Friends. The result is an empty Smart Group. Am I doing something wrong?