Health is not one of the apps that can be deleted.
Remove built-in Apple apps from the Home screen on your iOS 10 device or Apple Watch - Apple Support
The amount of space an app takes up is very, very small.
If you see a badge on the Settings icon, it usually means that your software needs updating. Go to Settings>General>Software Update and perform the update.