Mail app icon badge only showing for inbox, but not other sub-inboxes.

My mail app badge count only increases when I get emails in to my inbox folder only. I have my mail set up so it automatically sorts the incoming mail in to appropriate folders, but the other folders like "Other" and "Work" don't add to my badge count, yet another one that says "School" DOES add to the badge count. This is all within one email address.

Issue is on my both my iPad Air and my iPhone 4. The mail still shows up in my folders as unread once I open the app, but unless I open the app I don't know how many are unread. The notification settings are set to "Show Notifications", "Bad Icon" is on, etc. etc.