Can I use my Apple TV at all without internet?

Depends on what model Apple TV you have and what you're intending to do.

You would need a 3rd gen (REV A) or later to use peer to peer airplay and not all content would be viewable (i.e. iTunes purchases)

This should be helpful