How do I make all songs available for offline listening?

You can do it by Album, Artist, Genre, or Song. But there is no "bulk" way to do it.

Cheers,

GB

The best way to try, though it's always bugged out when I attempt it, is to make a smart playlist in desktop iTunes with the only qualification being that it's a song.
Then, save that playlist offline, on your phone.