How do I delete an app from an Apple TV

For Apple TV HD or 4K - you would highlight the app, hold down on the remote's touch pad until the icon starts to jiggle, then press the play/pause button and choose delete.

For older Apple TV - they don't run apps, just preset channels sent via server. As such there is nothing for a user to delete, but the icons can be hidden by going to settings - main menu