Are you sure Arrange By Name is what you want? The classic organization is Arrange By None and Sort By Name. In List View, with Arrange By None, you can sort by clicking on column heads.
In any case, if that is what you want, arrange a folder. Then View > Show View Options. Click "Use as Defaults".
For more info on the difference between Arrange and Sort, see this MacWorld article.