Using an iPhone 12 mini as an iPod after upgrading to a newer iPhone 14 Pro Mac

since Apple has discontinued the iPod, I was wondering if I could set up an older 12 mini for this function… what would I need to do? Just wanna use the Apple Music app. I download tons of music so all the playlists and albums will be on the device. Should I delete all other apps? Delete the cards from my wallet? Anything else security-wise that I should disable so this can be used on a construction site safely. I know I will still have iCloud enabled for the Music app. Thanks.