The apple TV can only be connected to your network one way at a time. You can connect it with ethernet to the same router that the mac mini server is on. Then set up "Home Sharing" on the media files of the mini server and the apple TV is all set to go. If that router is also capable of wireless connections (like an airport). Then the mini-server will also be available for the other macs.