The more fonts you have active, the more RAM they take up. True of any OS. The other of course is your font lists will take longer to appear in apps when you're selecting a font.
As far as cleaning up, separate your fonts into their uses. Web, epubs, etc., and only open (activate) the sets you need for the work you're doing. Close (deactivate) that set when you're done.