Apple Mail Avatar (profile image) - why it never shows?

Hey all,

I was very excited Apple brought this feature as Spark mail had it and it’s very convenient watching my inbox with all the relevant company logos showing near the mail, instantly telling me where it’s from.

However, it’s been a while since the feature came in and I almost never see an email showing the logo (avatar) except emails from Apple.

Even known companies like Amazon, eBay, Google…. Never show up with their avatar.

I’m trying to understand.

Does Apple expect me to manually add each sender to my contacts list followed by manually downloading the logo and adding it so that it will show up?

Or am I missing some key action that I haven’t done which will cause it to work properly?

Thanks!