No, I have not tried resetting the modem, as the
method is rather complicated. I have set up internet
access via DSL and do not want to confuse the machine
by doing PPP dialup configuration just in order to be
able to issue AT commands.
You could try a much simpler method. Try using
Z-Term. This will easily present you with a serial terminal window. When you launch Z-Term, it will hopefully find your modem. You can test this after a fresh start up. The default command for resetting the modem is "atz" (without the quotation marks). You could also try "ath0" (that's a zero at the end) to tell the modem to go back on hook. If it is the modem that is truly hung in the open state, you may not be able to communicate with it at all. This would indeed indicate that a restart of the computer would be necessary. That was one of the advantages of external modems. You could always recycle the power to reset the modem if it hung.
First: I cannot do this remote.
Second: This is complete non-apple-ish.
Third: This cannot be done automatically.
You can work on these after you find out if it is possible at all to reset the modem without a restart.
I'd rather take my chances kill()ing off processes
which is a 10 second effort, and I can even include
these in some automatic launchd configuration that is
ran regularly and upon awake from sleep.
You may be able to find out which processes are involved in receiving a fax by comparing the running processes at different intervals. This may best be done after a reboot of the computer. Open the Terminal and enter the command "ps awxx" (without quotation marks) and hit return. This will list the running processes. Now have someone send you a fax and look at what processes are running as you go through the process of receiving the fax. Sample the running processes using the same command as the phone rings, during the incoming fax, and after the fax is received. A text editor should help you compare the various output data. This may point to what processes need to be terminated when the modem hangs.
Mac Mini; B&W G3/300