can I get my 2004 iPod mini battery replaced

See Obtaining service for your Apple product after an expired warranty - Apple Support. Your model is considered obsolete and Apple no longer offer service options for it. You might find third party repair shops that will do it, and suitable batteries for DIY repair appear to be available from the usual online outlets.

tt2