In one column format, type your 24-pt title, then Insert > Layout Break.
Switch to two column format. Start your 12-pt list.
That's assuming that you don't want a title on each page.
If you do want a title on each page, use the Header field to hold the title, and forget about the Insert > Layout Break. Just use two column layout.