The MDC's do not appear to be failing over and have not given this crash message.
The crashes only happen on the Workstations.
I restarted the entire system (Workstations, Servers, and RAIDs) and that seemed to fix it for 2 days. Now it's back to crashing.
We also appear to have some "ghost" volumes after it fails, where the volume will not show up in Finder but will show up in Terminal.
That and everytime the machine is restarted it builds a new file in /cores which is taking up quite a bit of space.
The server logs do not say much.
The workstation logs state that "FSMPM is not responding" and a few moments later the volumes dismount from the workstation.
The Volumes have never dismounted from the server, only the workstations.
I have a far-fetched idea of what may be happening. The workstations are both Mac Pros (5,1) and have Pioneer BluRay Drives installed. Since the 10.8.5 update they have been disconnecting at random and the XSAN volumes follow the bluray drive.
Also, an update on BlackMagic Disk Test. It does not appear to be the problem, I have retested it and used subfolders for each machine as the test area. The volumes stay mounted under stress.