Q: xsan 2 volume mounts but not showing data on MDC
*Hi all,*
*I am using Xsan 2 , xserve raid and xserve server (Intel), The problem is my xsan volume mounts but it is not showing the data inside and it keep spinning the gathering info wheel . And after some time its dissconnect the xsan volume and mount it again .*
*I can not able to stop my volume and unmoumt xsan volume from MDC.Please help*
*Here are the logs..*
*[1028 14:44:15.046249] 0xa01b0fa0 (Debug) VOP SUMMARY [delrsngmd2.sapient.com] VopGetattrV4 cnt/1 avg/66 min/66 max/66.*
*[1028 14:44:15.046253] 0xa01b0fa0 (Debug) VOP SUMMARY [delrsngmd2.sapient.com] VopLookupV4 cnt/3977 avg/298 min/16 max/42407.*
*[1028 14:44:15.046257] 0xa01b0fa0 (Debug) VOP SUMMARY [delrsngmd2.sapient.com] VopCapNegotiate cnt/1 avg/29 min/29 max/29.*
*[1028 14:44:15.046262] 0xa01b0fa0 (Debug) VOP SUMMARY [delrsngmd2.sapient.com] VopClientId cnt/1 avg/19 min/19 max/19.*
*[1028 14:44:15.046266] 0xa01b0fa0 (Debug) VOP SUMMARY [delrsngmd2.sapient.com] GetLinkInfo cnt/19 avg/42 min/17 max/106.*
*[1028 14:44:15.046275] 0xa01b0fa0 (Debug) TKN SUMMARY [delrsngmd2.sapient.com] TokenRequestV2 cnt/2 avg/52 min/48 max/57.*
*[1028 14:44:15.046280] 0xa01b0fa0 (Debug) TKN SUMMARY [delrsngmd2.sapient.com] TokenRequestV3 cnt/423 avg/252 min/14 max/2682.*
*[1028 14:44:15.046285] 0xa01b0fa0 (Debug) TKN SUMMARY [delrsngmd2.sapient.com] TokenChangeV4 cnt/2006 avg/14 min/1 max/215.*
*[1028 14:44:15.046289] 0xa01b0fa0 (Debug) TKN SUMMARY [delrsngmd2.sapient.com] TokenReqAlloc cnt/7 avg/1074 min/606 max/1730.*
*[1028 14:44:15.046339] 0xa01b0fa0 (Debug) BRL SUMMARY [delrsngmd2.sapient.com] SetLock cnt/29 avg/33 min/8 max/83.*
*[1028 14:44:15.046350] 0xa01b0fa0 (Debug) BRL SUMMARY [delrsngmd2.sapient.com] ClearLock cnt/7 avg/32 min/23 max/51.*
*[1028 14:44:15.046355] 0xa01b0fa0 (Debug) BRL SUMMARY [delrsngmd2.sapient.com] ReconDone cnt/1 avg/35 min/35 max/35.*
*[1028 14:44:15] 0xb040f000 (*FATAL*) PANIC: aborting threads now.*
*Logger_thread: sleeps/445 signals/0 flushes/20 writes/20 switches 0*
*Logger_thread: logged/140 clean/140 toss/0 signalled/0 toss_message/0*
*Logger_thread: waited/0 awakened/0*
*[1028 14:44:39] 0xa01b0fa0 (Info) Server Revision 3.1.0 Build 2 (339.12)*
*[1028 14:44:39] 0xa01b0fa0 (Info) Built for Darwin 9.0 ppc*
*[1028 14:44:39] 0xa01b0fa0 (Info) Created on Tue Feb 19 17:29:50 PST 2008*
*[1028 14:44:39] 0xa01b0fa0 (Info) Built in /SourceCache/XsanFS/XsanFS-339.12*
*[1028 14:44:39] 0xa01b0fa0 (Info)*
Configuration:
DiskTypes-2
Disks-2
StripeGroups-2
ForceStripeAlignment-1
MaxConnections-139
ThreadPoolSize-256
StripeAlignSize-256
FsBlockSize-4096
BufferCacheSize-32M
InodeCacheSize-8192
RestoreJournal-Disabled
RestoreJournalDir-None
*[1028 14:44:39] 0xa01b0fa0 (Info) Self (delrsngmd2.sapient.com) IP address is 10.210.7.140.*
*[1028 14:44:39.466397] 0xa01b0fa0 (Debug) No fsports file - port range enforcement disabled.*
*[1028 14:44:39] 0xa01b0fa0 (Info) Listening on TCP socket delrsngmd2.sapient.com:51844*
*[1028 14:44:39] 0xa01b0fa0 (Info) Node [0] [delrsngmd2.sapient.c:51844] File System Manager Login.*
*[1028 14:44:39] 0xa01b0fa0 (Info) Service standing by on host 'delrsngmd2.sapient.com:51844'.*
*[1028 14:44:40.055449] 0xa01b0fa0 (Debug) FOUsurpCheck: read ARB info (pass 1): host (10.210.7.140:51330) conns 0 age 1288257255.00 secs his delta 0.00 secs my delta 0.00 secs.*
*[1028 14:44:40.055466] 0xa01b0fa0 (Debug) FOUsurpCheck: polling ARB block to check for active peer (pass 1).*
*[1028 14:44:41.055923] 0xa01b0fa0 (Debug) FOUsurpCheck: read ARB info (pass 2): host (10.210.7.140:51330) conns 0 age 1288257255.00 secs his delta 0.00 secs my delta 1.00 secs.*
*[1028 14:44:41.055942] 0xa01b0fa0 (Debug) FOUsurpCheck: ARB is already mine.*
*[1028 14:44:41] 0xa01b0fa0 (Info) Branding Arbitration Block (attempt 1) votes 0.*
*[1028 14:44:43.057663] 0xa01b0fa0 (Debug) Cannot find fail over script [/Library/Filesystems/Xsan/bin/cvfail.delrsngmd2.sapient.com] - looking for generic script.*
*[1028 14:44:43] 0xa01b0fa0 (Info) Launching fail over script ["/Library/Filesystems/Xsan/bin/cvfail" delrsngmd2.sapient.com 51844 delrsngstgsan]*
*[1028 14:44:43.065857] 0xa01b0fa0 (Debug) Starting journal log recovery.*
*[1028 14:44:43.369332] 0xa01b0fa0 (Debug) Completed journal log recovery.*
*[1028 14:44:43.369715] 0xa01b0fa0 (Debug) Inodeinit_postactivation: FsStatus 0x903, Brl_ResyncState 1*
*[1028 14:44:43] 0xb8eb1000 (Info) FSM Alloc: Loading Stripe Group "delrsngstgmeta". 233.74 GB.*
*[1028 14:44:43] 0xb8f33000 (Info) FSM Alloc: Loading Stripe Group "delrsngstgdata". 2.27 TB.*
*[1028 14:44:43] 0xb8eb1000 (Info) FSM Alloc: Stripe Group "delrsngstgmeta" active.*
*[1028 14:44:44] 0xb8f33000 (Info) FSM Alloc: free blocks 563481211 with 0 blocks currently reserved for client delayed buffers.Reserved blocks may change with client activity.*
*[1028 14:44:44] 0xb8f33000 (Info) FSM Alloc: Stripe Group "delrsngstgdata" active.*
*[1028 14:44:44] 0xa01b0fa0 (Info) File System Service 'delrsngstgsan[0]' now active on host 'delrsngmd2.sapient.com:51844'.*
*[1028 14:44:44.812230] 0xa01b0fa0 (Debug) Node [1] [delrsngmd2.sapient.com:51854] connected.*
*[1028 14:44:44.812371] 0xa01b0fa0 (Debug) Active service - NSS ping from delrsngmd2.sapient.com:51853.*
*[1028 14:44:44] 0xb4613000 (Info) Node [1] [delrsngmd2.sapient.c:51854] Client Login (active 1).*
*[1028 14:44:44.866632] 0xa01b0fa0 (Debug) Active service - NSS ping from delrsngmd2.sapient.com:51865.*
*[1028 14:44:44.866816] 0xa01b0fa0 (Debug) Node [2] [delrsngmd2.sapient.com:51866] connected.*
*[1028 14:44:44] 0xb90b9000 (Info) Node [2] [delrsngmd2.sapient.c:51866] Administrator Logout.*
*[1028 14:44:44] 0xb60fd000 (Info) XsanSpotlightGetSearchLevel: Unable to copy store attributes -> No index*
*[1028 14:44:44.900237] 0xa01b0fa0 (Debug) Active service - NSS ping from delrsngmd2.sapient.com:51869.*
*[1028 14:44:44.900388] 0xa01b0fa0 (Debug) Node [3] [delrsngmd2.sapient.com:51870] connected.*
*[1028 14:44:44.913224] 0xb7039000 (Debug) Alloc max us latency 5986 inode 0x1f0000067569eb byte hint 0x1000 actual 0x1000*
*[1028 14:44:44] 0xb90b9000 (Info) Node [3] [delrsngmd2.sapient.c:51870] Administrator Logout.*
*[1028 14:44:45.158467] 0xa01b0fa0 (Debug) Node [4] [delrsngmd2.sapient.com:51880] connected.*
*[1028 14:44:45.158623] 0xa01b0fa0 (Debug) Active service - NSS ping from delrsngmd2.sapient.com:51879.*
*[1028 14:44:45] 0xb90b9000 (Info) Node [4] [delrsngmd2.sapient.c:51880] Administrator Logout.*
*[1028 14:44:47.253367] 0xa01b0fa0 (Debug) Active service - NSS ping from delrsngmd2.sapient.com:51885.*
*[1028 14:44:47.253522] 0xa01b0fa0 (Debug) Node [5] [delrsngmd2.sapient.com:51886] connected.*
*[1028 14:44:47] 0xb90b9000 (Info) Node [5] [delrsngmd2.sapient.c:51886] Administrator Logout.*
*[1028 14:44:47] 0xb54cd000 (Info) XsanSpotlightGetSearchLevel: Unable to copy store attributes -> No index*
*[1028 14:44:49] 0xb0207000 (Info) DiskArb: setting Spotlight search level to 0*
*[1028 14:44:50.347154] 0xa01b0fa0 (Debug) Active service - NSS ping from delrsngmd2.sapient.com:51896.*
*[1028 14:44:50.347297] 0xa01b0fa0 (Debug) Node [6] [delrsngmd2.sapient.com:51897] connected.*
*[1028 14:44:50] 0xb90b9000 (Info) Node [6] [delrsngmd2.sapient.c:51897] Administrator Logout.*
*[1028 14:44:50] 0xb79df000 (Info) XsanSpotlightGetSearchLevel: Unable to copy store attributes -> No index*
*[1028 14:44:50.805874] 0xa01b0fa0 (Debug) Active service - NSS ping from delrsngmd2.sapient.com:51903.*
*[1028 14:44:50.805983] 0xa01b0fa0 (Debug) Node [7] [delrsngmd2.sapient.com:51904] connected.*
*[1028 14:44:50] 0xb90b9000 (Info) Node [7] [delrsngmd2.sapient.c:51904] Administrator Logout.*
*[1028 14:44:50] 0xb7ff7000 (Info) XsanSpotlightGetSearchLevel: Unable to copy store attributes -> No index*
*[1028 14:44:54] 0xb0207000 (Info) XsanSpotlightSetSearchLevel: creating thread to update Spotlight state*
*[1028 14:44:54] 0xb90b9000 (Info) doXsanSpotlightSetSearchLevel: Unable to copy store attributes (0), sleeping...*
*[1028 14:45:24] 0xb90b9000 (Info) doXsanSpotlightSetSearchLevel: Unable to copy store attributes (1), sleeping...*
*[1028 14:45:32.203278] 0xa01b0fa0 (Debug) Active service - NSS ping from delrsngmd2.sapient.com:51993.*
*[1028 14:45:32.203447] 0xa01b0fa0 (Debug) Node [8] [delrsngmd2.sapient.com:51994] connected.*
*[1028 14:45:32] 0xb0207000 (Info) Node [8] [delrsngmd2.sapient.c:51994] Administrator Logout.*
*[1028 14:45:32] 0xb5757000 (Info) XsanSpotlightGetSearchLevel: Unable to copy store attributes -> unknown state*
*[1028 14:45:40.599214] 0xa01b0fa0 (Debug) Active service - NSS ping from delrsngmd2.sapient.com:52006.*
*[1028 14:45:40.599374] 0xa01b0fa0 (Debug) Node [9] [delrsngmd2.sapient.com:52007] connected.*
*[1028 14:45:40] 0xb0207000 (Info) Node [9] [delrsngmd2.sapient.c:52007] Administrator Logout.*
*[1028 14:45:54] 0xb90b9000 (Info) doXsanSpotlightSetSearchLevel: Unable to copy store attributes (2), sleeping...*
*[1028 14:46:32.192282] 0xa01b0fa0 (Debug) Active service - NSS ping from delrsngmd2.sapient.com:52111.*
*[1028 14:46:32.192381] 0xa01b0fa0 (Debug) Node [10] [delrsngmd2.sapient.com:52112] connected.*
*[1028 14:46:32] 0xb0207000 (Info) Node [10] [delrsngmd2.sapient.c:52112] Administrator Logout.*
*[1028 14:46:34] 0xb90b9000 (Info) doXsanSpotlightSetSearchLevel: Unable to copy store attributes (3), sleeping...*
*[1028 14:46:42] 0xb6d2d000 (Info) XsanSpotlightGetSearchLevel: Unable to copy store attributes -> unknown state*
*[1028 14:46:42.299224] 0xa01b0fa0 (Debug) Active service - NSS ping from delrsngmd2.sapient.com:52137.*
*[1028 14:46:42.299382] 0xa01b0fa0 (Debug) Node [11] [delrsngmd2.sapient.com:52138] connected.*
*[1028 14:46:42] 0xb0207000 (Info) Node [11] [delrsngmd2.sapient.c:52138] Administrator Logout.*
*[1028 14:47:14] 0xb90b9000 (Info) doXsanSpotlightSetSearchLevel: Unable to copy store attributes (4), sleeping...*
*[1028 14:47:32.165186] 0xa01b0fa0 (Debug) Node [12] [delrsngmd2.sapient.com:52238] connected.*
*[1028 14:47:32.165343] 0xa01b0fa0 (Debug) Active service - NSS ping from delrsngmd2.sapient.com:52237.*
*[1028 14:47:32] 0xb0207000 (Info) Node [12] [delrsngmd2.sapient.c:52238] Administrator Logout.*
*[1028 14:47:42] 0xb70bb000 (Info) XsanSpotlightGetSearchLevel: Unable to copy store attributes -> unknown state*
*[1028 14:47:42.199907] 0xa01b0fa0 (Debug) Active service - NSS ping from delrsngmd2.sapient.com:52260.*
*[1028 14:47:42.200107] 0xa01b0fa0 (Debug) Node [13] [delrsngmd2.sapient.com:52261] connected.*
*[1028 14:47:42] 0xb0207000 (Info) Node [13] [delrsngmd2.sapient.c:52261] Administrator Logout.*
*[1028 14:47:54] 0xb90b9000 (Info) doXsanSpotlightSetSearchLevel: Unable to copy store attributes (5), sleeping...*
*[1028 14:48:32.195824] 0xa01b0fa0 (Debug) Active service - NSS ping from delrsngmd2.sapient.com:52334.*
*[1028 14:48:32.196065] 0xa01b0fa0 (Debug) Node [14] [delrsngmd2.sapient.com:52335] connected.*
*[1028 14:48:32] 0xb0207000 (Info) Node [14] [delrsngmd2.sapient.c:52335] Administrator Logout.*
*[1028 14:48:34] 0xb90b9000 (Info) doXsanSpotlightSetSearchLevel: Unable to copy store attributes (6), sleeping...*
*[1028 14:48:36] 0xb0491000 (*FATAL*) PANIC: /Library/Filesystems/Xsan/bin/fsm "OpHangLimitSecs exceeded VOP-Class-0 Type-22 Subtype-0 183.14 secs Conn[1] Thread-0xb6eb3000 Pqueue-0x20dd18 Workp-0x1de018 MsgQ-0x1de008 Msg-0x1de05c now 0x493a9d3a62e76 started 0x493a9c8bbba7e limit 180 secs.*
" file queues.c, line 619
[1028 14:48:36.482542] 0xa01b0fa0 (Debug) Listener_thread: flushing journal.
[1028 14:48:36.482561] 0xa01b0fa0 (Debug) Listener_thread: journal flush complete.
[1028 14:48:36.482596] 0xa01b0fa0 (Debug) FSM memory SUMMARY resident size 63MB.
[1028 14:48:36.482601] 0xa01b0fa0 (Debug) FSM I/O SUMMARY writes total/1025.
[1028 14:48:36.482605] 0xa01b0fa0 (Debug) FSM I/O SUMMARY writes journal/202 sb/0 buf/341 abm/36.
[1028 14:48:36.482610] 0xa01b0fa0 (Debug) FSM I/O SUMMARY writes inode/266 ganged/313 (14.71%).
[1028 14:48:36.482613] 0xa01b0fa0 (Debug) FSM wait SUMMARY inode pool expand waits/0.
[1028 14:48:36.482615] 0xa01b0fa0 (Debug) FSM wait SUMMARY journal waits/0.
[1028 14:48:36.482619] 0xa01b0fa0 (Debug) FSM wait SUMMARY journal bytes used avg/178610 max/869376.
[1028 14:48:36.482622] 0xa01b0fa0 (Debug) FSM wait SUMMARY free buffer waits/0.
[1028 14:48:36.482624] 0xa01b0fa0 (Debug) FSM wait SUMMARY free inode waits/5155.
[1028 14:48:36.482629] 0xa01b0fa0 (Debug) FSM wait SUMMARY revokes/0 avg/0 min/0 max/0.
[1028 14:48:36.482632] 0xa01b0fa0 (Debug) FSM threads SUMMARY max busy hi-prio/8 lo-prio/3.
[1028 14:48:36.482635] 0xa01b0fa0 (Debug) FSM threads SUMMARY max busy dmig/0 events/0.
[1028 14:48:36.482638] 0xa01b0fa0 (Debug) FSM msg queue SUMMARY hi-prio now/0 min/0 max/4.
[1028 14:48:36.482641] 0xa01b0fa0 (Debug) FSM msg queue SUMMARY lo-prio now/0 min/0 max/3.
[1028 14:48:36.482644] 0xa01b0fa0 (Debug) FSM msg queue SUMMARY dmig now/0 min/0 max/0.
[1028 14:48:36.482647] 0xa01b0fa0 (Debug) FSM msg queue SUMMARY events now/0 min/0 max/0.
[1028 14:48:36.482651] 0xa01b0fa0 (Debug) FSM cache SUMMARY inode lookups/25696 misses/10321 hits/59.83%.
[1028 14:48:36.482654] 0xa01b0fa0 (Debug) FSM cache SUMMARY free incore inodes now/0 min/0 max/8192.
[1028 14:48:36.482658] 0xa01b0fa0 (Debug) FSM cache SUMMARY buffer lookups/20507 misses/3575 hits/82.57%.
[1028 14:48:36.482661] 0xa01b0fa0 (Debug) FSM cache SUMMARY free buffers now/8192 min/1 max/8192.
[1028 14:48:36.482664] 0xa01b0fa0 (Debug) FSM cache SUMMARY attrs now/180 min/1 max/180.
[1028 14:48:36.482668] 0xa01b0fa0 (Debug) FSM extent SUMMARY extent lookups/2754 misses/49 hits/98.22%.
[1028 14:48:36.482671] 0xa01b0fa0 (Debug) FSM extent SUMMARY hint tries/0 misses/0 hits/0.00%.
[1028 14:48:36.482683] 0xa01b0fa0 (Debug) VOP SUMMARY Readdir cnt/5 avg/45 min/32 max/82.
[1028 14:48:36.482689] 0xa01b0fa0 (Debug) VOP SUMMARY Setattr cnt/516 avg/105 min/8 max/3612.
[1028 14:48:36.482694] 0xa01b0fa0 (Debug) VOP SUMMARY Remove cnt/38 avg/1280 min/542 max/6407.
[1028 14:48:36.482698] 0xa01b0fa0 (Debug) VOP SUMMARY Open cnt/280 avg/70 min/17 max/2597.
[1028 14:48:36.482703] 0xa01b0fa0 (Debug) VOP SUMMARY Close cnt/184 avg/35 min/17 max/141.
[1028 14:48:36.482707] 0xa01b0fa0 (Debug) VOP SUMMARY PunchHoleApi cnt/4 avg/151 min/76 max/241.
[1028 14:48:36.482712] 0xa01b0fa0 (Debug) VOP SUMMARY CreateV3 cnt/38 avg/5290 min/109 max/49094.
[1028 14:48:36.482717] 0xa01b0fa0 (Debug) VOP SUMMARY VopLookupV4 cnt/358 avg/976 min/15 max/32093.
[1028 14:48:36.482721] 0xa01b0fa0 (Debug) VOP SUMMARY VopCapNegotiate cnt/1 avg/40 min/40 max/40.
[1028 14:48:36.482726] 0xa01b0fa0 (Debug) VOP SUMMARY VopClientId cnt/1 avg/21 min/21 max/21.
[1028 14:48:36.482730] 0xa01b0fa0 (Debug) VOP SUMMARY GetResyncAttr cnt/142 avg/902 min/11 max/28838.
[1028 14:48:36.482735] 0xa01b0fa0 (Debug) VOP SUMMARY GetLinkInfo cnt/50 avg/32 min/17 max/65.
[1028 14:48:36.482741] 0xa01b0fa0 (Debug) TKN SUMMARY TokenRequestV2 cnt/2 avg/36 min/34 max/38.
[1028 14:48:36.482745] 0xa01b0fa0 (Debug) TKN SUMMARY TokenRequestV3 cnt/33 avg/29 min/18 max/58.
[1028 14:48:36.482750] 0xa01b0fa0 (Debug) TKN SUMMARY TokenChangeV4 cnt/450 avg/24 min/1 max/2369.
[1028 14:48:36.482758] 0xa01b0fa0 (Debug) TKN SUMMARY TokenReqAlloc cnt/18 avg/1065 min/507 max/6035.
[1028 14:48:36.482767] 0xa01b0fa0 (Debug) BRL SUMMARY SetLock cnt/5 avg/32 min/22 max/39.
[1028 14:48:36.482772] 0xa01b0fa0 (Debug) BRL SUMMARY ClearLock cnt/55 avg/35 min/18 max/103.
[1028 14:48:36.482776] 0xa01b0fa0 (Debug) BRL SUMMARY ClearAll cnt/16 avg/28 min/12 max/58.
[1028 14:48:36.482780] 0xa01b0fa0 (Debug) BRL SUMMARY ReconDone cnt/1 avg/37 min/37 max/37.
[1028 14:48:36.482792] 0xa01b0fa0 (Debug) BRL SUMMARY RestoreLock cnt/4 avg/45 min/27 max/75.
[1028 14:48:36.482802] 0xa01b0fa0 (Debug) SG SUMMARY delrsngstgmeta space total/233.74 GB free/232.93 GB (99.65%)
[1028 14:48:36.482809] 0xa01b0fa0 (Debug) SG SUMMARY delrsngstgmeta space minfree/232.93 GB (99.65%) maxfree/232.93 GB (99.65%)
[1028 14:48:36.482813] 0xa01b0fa0 (Debug) SG SUMMARY delrsngstgmeta alloc extent cnt/0 avgsize/0.00 B.
[1028 14:48:36.482817] 0xa01b0fa0 (Debug) SG SUMMARY 305 btree free space fragments 547 splay tree fragments
[1028 14:48:36.482822] 0xa01b0fa0 (Debug) SG SUMMARY delrsngstgdata space total/2.27 TB free/2.10 TB (92.30%)
[1028 14:48:36.482828] 0xa01b0fa0 (Debug) SG SUMMARY delrsngstgdata space minfree/2.10 TB (92.30%) maxfree/2.10 TB (92.30%)
[1028 14:48:36.482832] 0xa01b0fa0 (Debug) SG SUMMARY delrsngstgdata alloc extent cnt/18 avgsize/8.00 KB.
[1028 14:48:36.482836] 0xa01b0fa0 (Debug) SG SUMMARY 3147 btree free space fragments 6172 splay tree fragments
[1028 14:48:36.482849] 0xa01b0fa0 (Debug) PIO HiPriWr SUMMARY META cnt/203 maxq/0.
[1028 14:48:36.482853] 0xa01b0fa0 (Debug) PIO HiPriWr SUMMARY META avg/506 min/278 max/1596.
[1028 14:48:36.482857] 0xa01b0fa0 (Debug) PIO HiPriWr SUMMARY META sysavg/502 sysmin/277 sysmax/1596.
[1028 14:48:36.482862] 0xa01b0fa0 (Debug) PIO HiPriWr SUMMARY META avglen/3099 minlen/512 maxlen/32768.
[1028 14:48:36.482865] 0xa01b0fa0 (Debug) PIO Read SUMMARY META cnt/5091 maxq/9.
[1028 14:48:36.482870] 0xa01b0fa0 (Debug) PIO Read SUMMARY META avg/3044 min/265 max/172422.
[1028 14:48:36.482874] 0xa01b0fa0 (Debug) PIO Read SUMMARY META sysavg/1693 sysmin/239 sysmax/56187.
[1028 14:48:36.482878] 0xa01b0fa0 (Debug) PIO Read SUMMARY META avglen/85482 minlen/512 maxlen/1048576.
[1028 14:48:36.482882] 0xa01b0fa0 (Debug) PIO Write SUMMARY META cnt/823 maxq/5.
[1028 14:48:36.482886] 0xa01b0fa0 (Debug) PIO Write SUMMARY META avg/1127 min/255 max/49630.
[1028 14:48:36.482890] 0xa01b0fa0 (Debug) PIO Write SUMMARY META sysavg/329 sysmin/247 sysmax/5629.
[1028 14:48:36.482894] 0xa01b0fa0 (Debug) PIO Write SUMMARY META avglen/2062 minlen/512 maxlen/4096.
[1028 14:48:36.482899] 0xa01b0fa0 (Debug) Cache SUMMARY [delrsngmd2.sapient.com] attrs now/180 min/1 max/180.
[1028 14:48:36.482905] 0xa01b0fa0 (Debug) VOP SUMMARY [delrsngmd2.sapient.com] Readdir cnt/5 avg/45 min/32 max/82.
[1028 14:48:36.482909] 0xa01b0fa0 (Debug) VOP SUMMARY [delrsngmd2.sapient.com] Setattr cnt/516 avg/105 min/8 max/3612.
[1028 14:48:36.482914] 0xa01b0fa0 (Debug) VOP SUMMARY [delrsngmd2.sapient.com] Remove cnt/38 avg/1280 min/542 max/6407.
[1028 14:48:36.482919] 0xa01b0fa0 (Debug) VOP SUMMARY [delrsngmd2.sapient.com] Open cnt/280 avg/70 min/17 max/2597.
[1028 14:48:36.482923] 0xa01b0fa0 (Debug) VOP SUMMARY [delrsngmd2.sapient.com] Close cnt/184 avg/35 min/17 max/141.
[1028 14:48:36.482928] 0xa01b0fa0 (Debug) VOP SUMMARY [delrsngmd2.sapient.com] PunchHoleApi cnt/4 avg/151 min/76 max/241.
[1028 14:48:36.482933] 0xa01b0fa0 (Debug) VOP SUMMARY [delrsngmd2.sapient.com] CreateV3 cnt/38 avg/5290 min/109 max/49094.
[1028 14:48:36.482938] 0xa01b0fa0 (Debug) VOP SUMMARY [delrsngmd2.sapient.com] VopLookupV4 cnt/358 avg/976 min/15 max/32093.
[1028 14:48:36.482942] 0xa01b0fa0 (Debug) VOP SUMMARY [delrsngmd2.sapient.com] VopCapNegotiate cnt/1 avg/40 min/40 max/40.
[1028 14:48:36.482947] 0xa01b0fa0 (Debug) VOP SUMMARY [delrsngmd2.sapient.com] VopClientId cnt/1 avg/21 min/21 max/21.
[1028 14:48:36.482951] 0xa01b0fa0 (Debug) VOP SUMMARY [delrsngmd2.sapient.com] GetResyncAttr cnt/142 avg/902 min/11 max/28838.
[1028 14:48:36.482956] 0xa01b0fa0 (Debug) VOP SUMMARY [delrsngmd2.sapient.com] GetLinkInfo cnt/50 avg/32 min/17 max/65.
[1028 14:48:36.482965] 0xa01b0fa0 (Debug) TKN SUMMARY [delrsngmd2.sapient.com] TokenRequestV2 cnt/2 avg/36 min/34 max/38.
[1028 14:48:36.482970] 0xa01b0fa0 (Debug) TKN SUMMARY [delrsngmd2.sapient.com] TokenRequestV3 cnt/33 avg/29 min/18 max/58.
[1028 14:48:36.482975] 0xa01b0fa0 (Debug) TKN SUMMARY [delrsngmd2.sapient.com] TokenChangeV4 cnt/450 avg/24 min/1 max/2369.
[1028 14:48:36.482979] 0xa01b0fa0 (Debug) TKN SUMMARY [delrsngmd2.sapient.com] TokenReqAlloc cnt/18 avg/1065 min/507 max/6035.
[1028 14:48:36.482999] 0xa01b0fa0 (Debug) BRL SUMMARY [delrsngmd2.sapient.com] SetLock cnt/5 avg/32 min/22 max/39.
[1028 14:48:36.483004] 0xa01b0fa0 (Debug) BRL SUMMARY [delrsngmd2.sapient.com] ClearLock cnt/55 avg/35 min/18 max/103.
[1028 14:48:36.483008] 0xa01b0fa0 (Debug) BRL SUMMARY [delrsngmd2.sapient.com] ClearAll cnt/16 avg/28 min/12 max/58.
[1028 14:48:36.483013] 0xa01b0fa0 (Debug) BRL SUMMARY [delrsngmd2.sapient.com] ReconDone cnt/1 avg/37 min/37 max/37.
[1028 14:48:36.483017] 0xa01b0fa0 (Debug) BRL SUMMARY [delrsngmd2.sapient.com] RestoreLock cnt/4 avg/45 min/27 max/75.
[1028 14:48:36] 0xb0491000 (*FATAL*) PANIC: aborting threads now.
Logger_thread: sleeps/476 signals/0 flushes/27 writes/27 switches 0
Logger_thread: logged/175 clean/175 toss/0 signalled/0 toss_message/0
Logger_thread: waited/0 awakened/0
*I am using Xsan 2 , xserve raid and xserve server (Intel), The problem is my xsan volume mounts but it is not showing the data inside and it keep spinning the gathering info wheel . And after some time its dissconnect the xsan volume and mount it again .*
*I can not able to stop my volume and unmoumt xsan volume from MDC.Please help*
*Here are the logs..*
*[1028 14:44:15.046249] 0xa01b0fa0 (Debug) VOP SUMMARY [delrsngmd2.sapient.com] VopGetattrV4 cnt/1 avg/66 min/66 max/66.*
*[1028 14:44:15.046253] 0xa01b0fa0 (Debug) VOP SUMMARY [delrsngmd2.sapient.com] VopLookupV4 cnt/3977 avg/298 min/16 max/42407.*
*[1028 14:44:15.046257] 0xa01b0fa0 (Debug) VOP SUMMARY [delrsngmd2.sapient.com] VopCapNegotiate cnt/1 avg/29 min/29 max/29.*
*[1028 14:44:15.046262] 0xa01b0fa0 (Debug) VOP SUMMARY [delrsngmd2.sapient.com] VopClientId cnt/1 avg/19 min/19 max/19.*
*[1028 14:44:15.046266] 0xa01b0fa0 (Debug) VOP SUMMARY [delrsngmd2.sapient.com] GetLinkInfo cnt/19 avg/42 min/17 max/106.*
*[1028 14:44:15.046275] 0xa01b0fa0 (Debug) TKN SUMMARY [delrsngmd2.sapient.com] TokenRequestV2 cnt/2 avg/52 min/48 max/57.*
*[1028 14:44:15.046280] 0xa01b0fa0 (Debug) TKN SUMMARY [delrsngmd2.sapient.com] TokenRequestV3 cnt/423 avg/252 min/14 max/2682.*
*[1028 14:44:15.046285] 0xa01b0fa0 (Debug) TKN SUMMARY [delrsngmd2.sapient.com] TokenChangeV4 cnt/2006 avg/14 min/1 max/215.*
*[1028 14:44:15.046289] 0xa01b0fa0 (Debug) TKN SUMMARY [delrsngmd2.sapient.com] TokenReqAlloc cnt/7 avg/1074 min/606 max/1730.*
*[1028 14:44:15.046339] 0xa01b0fa0 (Debug) BRL SUMMARY [delrsngmd2.sapient.com] SetLock cnt/29 avg/33 min/8 max/83.*
*[1028 14:44:15.046350] 0xa01b0fa0 (Debug) BRL SUMMARY [delrsngmd2.sapient.com] ClearLock cnt/7 avg/32 min/23 max/51.*
*[1028 14:44:15.046355] 0xa01b0fa0 (Debug) BRL SUMMARY [delrsngmd2.sapient.com] ReconDone cnt/1 avg/35 min/35 max/35.*
*[1028 14:44:15] 0xb040f000 (*FATAL*) PANIC: aborting threads now.*
*Logger_thread: sleeps/445 signals/0 flushes/20 writes/20 switches 0*
*Logger_thread: logged/140 clean/140 toss/0 signalled/0 toss_message/0*
*Logger_thread: waited/0 awakened/0*
*[1028 14:44:39] 0xa01b0fa0 (Info) Server Revision 3.1.0 Build 2 (339.12)*
*[1028 14:44:39] 0xa01b0fa0 (Info) Built for Darwin 9.0 ppc*
*[1028 14:44:39] 0xa01b0fa0 (Info) Created on Tue Feb 19 17:29:50 PST 2008*
*[1028 14:44:39] 0xa01b0fa0 (Info) Built in /SourceCache/XsanFS/XsanFS-339.12*
*[1028 14:44:39] 0xa01b0fa0 (Info)*
Configuration:
DiskTypes-2
Disks-2
StripeGroups-2
ForceStripeAlignment-1
MaxConnections-139
ThreadPoolSize-256
StripeAlignSize-256
FsBlockSize-4096
BufferCacheSize-32M
InodeCacheSize-8192
RestoreJournal-Disabled
RestoreJournalDir-None
*[1028 14:44:39] 0xa01b0fa0 (Info) Self (delrsngmd2.sapient.com) IP address is 10.210.7.140.*
*[1028 14:44:39.466397] 0xa01b0fa0 (Debug) No fsports file - port range enforcement disabled.*
*[1028 14:44:39] 0xa01b0fa0 (Info) Listening on TCP socket delrsngmd2.sapient.com:51844*
*[1028 14:44:39] 0xa01b0fa0 (Info) Node [0] [delrsngmd2.sapient.c:51844] File System Manager Login.*
*[1028 14:44:39] 0xa01b0fa0 (Info) Service standing by on host 'delrsngmd2.sapient.com:51844'.*
*[1028 14:44:40.055449] 0xa01b0fa0 (Debug) FOUsurpCheck: read ARB info (pass 1): host (10.210.7.140:51330) conns 0 age 1288257255.00 secs his delta 0.00 secs my delta 0.00 secs.*
*[1028 14:44:40.055466] 0xa01b0fa0 (Debug) FOUsurpCheck: polling ARB block to check for active peer (pass 1).*
*[1028 14:44:41.055923] 0xa01b0fa0 (Debug) FOUsurpCheck: read ARB info (pass 2): host (10.210.7.140:51330) conns 0 age 1288257255.00 secs his delta 0.00 secs my delta 1.00 secs.*
*[1028 14:44:41.055942] 0xa01b0fa0 (Debug) FOUsurpCheck: ARB is already mine.*
*[1028 14:44:41] 0xa01b0fa0 (Info) Branding Arbitration Block (attempt 1) votes 0.*
*[1028 14:44:43.057663] 0xa01b0fa0 (Debug) Cannot find fail over script [/Library/Filesystems/Xsan/bin/cvfail.delrsngmd2.sapient.com] - looking for generic script.*
*[1028 14:44:43] 0xa01b0fa0 (Info) Launching fail over script ["/Library/Filesystems/Xsan/bin/cvfail" delrsngmd2.sapient.com 51844 delrsngstgsan]*
*[1028 14:44:43.065857] 0xa01b0fa0 (Debug) Starting journal log recovery.*
*[1028 14:44:43.369332] 0xa01b0fa0 (Debug) Completed journal log recovery.*
*[1028 14:44:43.369715] 0xa01b0fa0 (Debug) Inodeinit_postactivation: FsStatus 0x903, Brl_ResyncState 1*
*[1028 14:44:43] 0xb8eb1000 (Info) FSM Alloc: Loading Stripe Group "delrsngstgmeta". 233.74 GB.*
*[1028 14:44:43] 0xb8f33000 (Info) FSM Alloc: Loading Stripe Group "delrsngstgdata". 2.27 TB.*
*[1028 14:44:43] 0xb8eb1000 (Info) FSM Alloc: Stripe Group "delrsngstgmeta" active.*
*[1028 14:44:44] 0xb8f33000 (Info) FSM Alloc: free blocks 563481211 with 0 blocks currently reserved for client delayed buffers.Reserved blocks may change with client activity.*
*[1028 14:44:44] 0xb8f33000 (Info) FSM Alloc: Stripe Group "delrsngstgdata" active.*
*[1028 14:44:44] 0xa01b0fa0 (Info) File System Service 'delrsngstgsan[0]' now active on host 'delrsngmd2.sapient.com:51844'.*
*[1028 14:44:44.812230] 0xa01b0fa0 (Debug) Node [1] [delrsngmd2.sapient.com:51854] connected.*
*[1028 14:44:44.812371] 0xa01b0fa0 (Debug) Active service - NSS ping from delrsngmd2.sapient.com:51853.*
*[1028 14:44:44] 0xb4613000 (Info) Node [1] [delrsngmd2.sapient.c:51854] Client Login (active 1).*
*[1028 14:44:44.866632] 0xa01b0fa0 (Debug) Active service - NSS ping from delrsngmd2.sapient.com:51865.*
*[1028 14:44:44.866816] 0xa01b0fa0 (Debug) Node [2] [delrsngmd2.sapient.com:51866] connected.*
*[1028 14:44:44] 0xb90b9000 (Info) Node [2] [delrsngmd2.sapient.c:51866] Administrator Logout.*
*[1028 14:44:44] 0xb60fd000 (Info) XsanSpotlightGetSearchLevel: Unable to copy store attributes -> No index*
*[1028 14:44:44.900237] 0xa01b0fa0 (Debug) Active service - NSS ping from delrsngmd2.sapient.com:51869.*
*[1028 14:44:44.900388] 0xa01b0fa0 (Debug) Node [3] [delrsngmd2.sapient.com:51870] connected.*
*[1028 14:44:44.913224] 0xb7039000 (Debug) Alloc max us latency 5986 inode 0x1f0000067569eb byte hint 0x1000 actual 0x1000*
*[1028 14:44:44] 0xb90b9000 (Info) Node [3] [delrsngmd2.sapient.c:51870] Administrator Logout.*
*[1028 14:44:45.158467] 0xa01b0fa0 (Debug) Node [4] [delrsngmd2.sapient.com:51880] connected.*
*[1028 14:44:45.158623] 0xa01b0fa0 (Debug) Active service - NSS ping from delrsngmd2.sapient.com:51879.*
*[1028 14:44:45] 0xb90b9000 (Info) Node [4] [delrsngmd2.sapient.c:51880] Administrator Logout.*
*[1028 14:44:47.253367] 0xa01b0fa0 (Debug) Active service - NSS ping from delrsngmd2.sapient.com:51885.*
*[1028 14:44:47.253522] 0xa01b0fa0 (Debug) Node [5] [delrsngmd2.sapient.com:51886] connected.*
*[1028 14:44:47] 0xb90b9000 (Info) Node [5] [delrsngmd2.sapient.c:51886] Administrator Logout.*
*[1028 14:44:47] 0xb54cd000 (Info) XsanSpotlightGetSearchLevel: Unable to copy store attributes -> No index*
*[1028 14:44:49] 0xb0207000 (Info) DiskArb: setting Spotlight search level to 0*
*[1028 14:44:50.347154] 0xa01b0fa0 (Debug) Active service - NSS ping from delrsngmd2.sapient.com:51896.*
*[1028 14:44:50.347297] 0xa01b0fa0 (Debug) Node [6] [delrsngmd2.sapient.com:51897] connected.*
*[1028 14:44:50] 0xb90b9000 (Info) Node [6] [delrsngmd2.sapient.c:51897] Administrator Logout.*
*[1028 14:44:50] 0xb79df000 (Info) XsanSpotlightGetSearchLevel: Unable to copy store attributes -> No index*
*[1028 14:44:50.805874] 0xa01b0fa0 (Debug) Active service - NSS ping from delrsngmd2.sapient.com:51903.*
*[1028 14:44:50.805983] 0xa01b0fa0 (Debug) Node [7] [delrsngmd2.sapient.com:51904] connected.*
*[1028 14:44:50] 0xb90b9000 (Info) Node [7] [delrsngmd2.sapient.c:51904] Administrator Logout.*
*[1028 14:44:50] 0xb7ff7000 (Info) XsanSpotlightGetSearchLevel: Unable to copy store attributes -> No index*
*[1028 14:44:54] 0xb0207000 (Info) XsanSpotlightSetSearchLevel: creating thread to update Spotlight state*
*[1028 14:44:54] 0xb90b9000 (Info) doXsanSpotlightSetSearchLevel: Unable to copy store attributes (0), sleeping...*
*[1028 14:45:24] 0xb90b9000 (Info) doXsanSpotlightSetSearchLevel: Unable to copy store attributes (1), sleeping...*
*[1028 14:45:32.203278] 0xa01b0fa0 (Debug) Active service - NSS ping from delrsngmd2.sapient.com:51993.*
*[1028 14:45:32.203447] 0xa01b0fa0 (Debug) Node [8] [delrsngmd2.sapient.com:51994] connected.*
*[1028 14:45:32] 0xb0207000 (Info) Node [8] [delrsngmd2.sapient.c:51994] Administrator Logout.*
*[1028 14:45:32] 0xb5757000 (Info) XsanSpotlightGetSearchLevel: Unable to copy store attributes -> unknown state*
*[1028 14:45:40.599214] 0xa01b0fa0 (Debug) Active service - NSS ping from delrsngmd2.sapient.com:52006.*
*[1028 14:45:40.599374] 0xa01b0fa0 (Debug) Node [9] [delrsngmd2.sapient.com:52007] connected.*
*[1028 14:45:40] 0xb0207000 (Info) Node [9] [delrsngmd2.sapient.c:52007] Administrator Logout.*
*[1028 14:45:54] 0xb90b9000 (Info) doXsanSpotlightSetSearchLevel: Unable to copy store attributes (2), sleeping...*
*[1028 14:46:32.192282] 0xa01b0fa0 (Debug) Active service - NSS ping from delrsngmd2.sapient.com:52111.*
*[1028 14:46:32.192381] 0xa01b0fa0 (Debug) Node [10] [delrsngmd2.sapient.com:52112] connected.*
*[1028 14:46:32] 0xb0207000 (Info) Node [10] [delrsngmd2.sapient.c:52112] Administrator Logout.*
*[1028 14:46:34] 0xb90b9000 (Info) doXsanSpotlightSetSearchLevel: Unable to copy store attributes (3), sleeping...*
*[1028 14:46:42] 0xb6d2d000 (Info) XsanSpotlightGetSearchLevel: Unable to copy store attributes -> unknown state*
*[1028 14:46:42.299224] 0xa01b0fa0 (Debug) Active service - NSS ping from delrsngmd2.sapient.com:52137.*
*[1028 14:46:42.299382] 0xa01b0fa0 (Debug) Node [11] [delrsngmd2.sapient.com:52138] connected.*
*[1028 14:46:42] 0xb0207000 (Info) Node [11] [delrsngmd2.sapient.c:52138] Administrator Logout.*
*[1028 14:47:14] 0xb90b9000 (Info) doXsanSpotlightSetSearchLevel: Unable to copy store attributes (4), sleeping...*
*[1028 14:47:32.165186] 0xa01b0fa0 (Debug) Node [12] [delrsngmd2.sapient.com:52238] connected.*
*[1028 14:47:32.165343] 0xa01b0fa0 (Debug) Active service - NSS ping from delrsngmd2.sapient.com:52237.*
*[1028 14:47:32] 0xb0207000 (Info) Node [12] [delrsngmd2.sapient.c:52238] Administrator Logout.*
*[1028 14:47:42] 0xb70bb000 (Info) XsanSpotlightGetSearchLevel: Unable to copy store attributes -> unknown state*
*[1028 14:47:42.199907] 0xa01b0fa0 (Debug) Active service - NSS ping from delrsngmd2.sapient.com:52260.*
*[1028 14:47:42.200107] 0xa01b0fa0 (Debug) Node [13] [delrsngmd2.sapient.com:52261] connected.*
*[1028 14:47:42] 0xb0207000 (Info) Node [13] [delrsngmd2.sapient.c:52261] Administrator Logout.*
*[1028 14:47:54] 0xb90b9000 (Info) doXsanSpotlightSetSearchLevel: Unable to copy store attributes (5), sleeping...*
*[1028 14:48:32.195824] 0xa01b0fa0 (Debug) Active service - NSS ping from delrsngmd2.sapient.com:52334.*
*[1028 14:48:32.196065] 0xa01b0fa0 (Debug) Node [14] [delrsngmd2.sapient.com:52335] connected.*
*[1028 14:48:32] 0xb0207000 (Info) Node [14] [delrsngmd2.sapient.c:52335] Administrator Logout.*
*[1028 14:48:34] 0xb90b9000 (Info) doXsanSpotlightSetSearchLevel: Unable to copy store attributes (6), sleeping...*
*[1028 14:48:36] 0xb0491000 (*FATAL*) PANIC: /Library/Filesystems/Xsan/bin/fsm "OpHangLimitSecs exceeded VOP-Class-0 Type-22 Subtype-0 183.14 secs Conn[1] Thread-0xb6eb3000 Pqueue-0x20dd18 Workp-0x1de018 MsgQ-0x1de008 Msg-0x1de05c now 0x493a9d3a62e76 started 0x493a9c8bbba7e limit 180 secs.*
" file queues.c, line 619
[1028 14:48:36.482542] 0xa01b0fa0 (Debug) Listener_thread: flushing journal.
[1028 14:48:36.482561] 0xa01b0fa0 (Debug) Listener_thread: journal flush complete.
[1028 14:48:36.482596] 0xa01b0fa0 (Debug) FSM memory SUMMARY resident size 63MB.
[1028 14:48:36.482601] 0xa01b0fa0 (Debug) FSM I/O SUMMARY writes total/1025.
[1028 14:48:36.482605] 0xa01b0fa0 (Debug) FSM I/O SUMMARY writes journal/202 sb/0 buf/341 abm/36.
[1028 14:48:36.482610] 0xa01b0fa0 (Debug) FSM I/O SUMMARY writes inode/266 ganged/313 (14.71%).
[1028 14:48:36.482613] 0xa01b0fa0 (Debug) FSM wait SUMMARY inode pool expand waits/0.
[1028 14:48:36.482615] 0xa01b0fa0 (Debug) FSM wait SUMMARY journal waits/0.
[1028 14:48:36.482619] 0xa01b0fa0 (Debug) FSM wait SUMMARY journal bytes used avg/178610 max/869376.
[1028 14:48:36.482622] 0xa01b0fa0 (Debug) FSM wait SUMMARY free buffer waits/0.
[1028 14:48:36.482624] 0xa01b0fa0 (Debug) FSM wait SUMMARY free inode waits/5155.
[1028 14:48:36.482629] 0xa01b0fa0 (Debug) FSM wait SUMMARY revokes/0 avg/0 min/0 max/0.
[1028 14:48:36.482632] 0xa01b0fa0 (Debug) FSM threads SUMMARY max busy hi-prio/8 lo-prio/3.
[1028 14:48:36.482635] 0xa01b0fa0 (Debug) FSM threads SUMMARY max busy dmig/0 events/0.
[1028 14:48:36.482638] 0xa01b0fa0 (Debug) FSM msg queue SUMMARY hi-prio now/0 min/0 max/4.
[1028 14:48:36.482641] 0xa01b0fa0 (Debug) FSM msg queue SUMMARY lo-prio now/0 min/0 max/3.
[1028 14:48:36.482644] 0xa01b0fa0 (Debug) FSM msg queue SUMMARY dmig now/0 min/0 max/0.
[1028 14:48:36.482647] 0xa01b0fa0 (Debug) FSM msg queue SUMMARY events now/0 min/0 max/0.
[1028 14:48:36.482651] 0xa01b0fa0 (Debug) FSM cache SUMMARY inode lookups/25696 misses/10321 hits/59.83%.
[1028 14:48:36.482654] 0xa01b0fa0 (Debug) FSM cache SUMMARY free incore inodes now/0 min/0 max/8192.
[1028 14:48:36.482658] 0xa01b0fa0 (Debug) FSM cache SUMMARY buffer lookups/20507 misses/3575 hits/82.57%.
[1028 14:48:36.482661] 0xa01b0fa0 (Debug) FSM cache SUMMARY free buffers now/8192 min/1 max/8192.
[1028 14:48:36.482664] 0xa01b0fa0 (Debug) FSM cache SUMMARY attrs now/180 min/1 max/180.
[1028 14:48:36.482668] 0xa01b0fa0 (Debug) FSM extent SUMMARY extent lookups/2754 misses/49 hits/98.22%.
[1028 14:48:36.482671] 0xa01b0fa0 (Debug) FSM extent SUMMARY hint tries/0 misses/0 hits/0.00%.
[1028 14:48:36.482683] 0xa01b0fa0 (Debug) VOP SUMMARY Readdir cnt/5 avg/45 min/32 max/82.
[1028 14:48:36.482689] 0xa01b0fa0 (Debug) VOP SUMMARY Setattr cnt/516 avg/105 min/8 max/3612.
[1028 14:48:36.482694] 0xa01b0fa0 (Debug) VOP SUMMARY Remove cnt/38 avg/1280 min/542 max/6407.
[1028 14:48:36.482698] 0xa01b0fa0 (Debug) VOP SUMMARY Open cnt/280 avg/70 min/17 max/2597.
[1028 14:48:36.482703] 0xa01b0fa0 (Debug) VOP SUMMARY Close cnt/184 avg/35 min/17 max/141.
[1028 14:48:36.482707] 0xa01b0fa0 (Debug) VOP SUMMARY PunchHoleApi cnt/4 avg/151 min/76 max/241.
[1028 14:48:36.482712] 0xa01b0fa0 (Debug) VOP SUMMARY CreateV3 cnt/38 avg/5290 min/109 max/49094.
[1028 14:48:36.482717] 0xa01b0fa0 (Debug) VOP SUMMARY VopLookupV4 cnt/358 avg/976 min/15 max/32093.
[1028 14:48:36.482721] 0xa01b0fa0 (Debug) VOP SUMMARY VopCapNegotiate cnt/1 avg/40 min/40 max/40.
[1028 14:48:36.482726] 0xa01b0fa0 (Debug) VOP SUMMARY VopClientId cnt/1 avg/21 min/21 max/21.
[1028 14:48:36.482730] 0xa01b0fa0 (Debug) VOP SUMMARY GetResyncAttr cnt/142 avg/902 min/11 max/28838.
[1028 14:48:36.482735] 0xa01b0fa0 (Debug) VOP SUMMARY GetLinkInfo cnt/50 avg/32 min/17 max/65.
[1028 14:48:36.482741] 0xa01b0fa0 (Debug) TKN SUMMARY TokenRequestV2 cnt/2 avg/36 min/34 max/38.
[1028 14:48:36.482745] 0xa01b0fa0 (Debug) TKN SUMMARY TokenRequestV3 cnt/33 avg/29 min/18 max/58.
[1028 14:48:36.482750] 0xa01b0fa0 (Debug) TKN SUMMARY TokenChangeV4 cnt/450 avg/24 min/1 max/2369.
[1028 14:48:36.482758] 0xa01b0fa0 (Debug) TKN SUMMARY TokenReqAlloc cnt/18 avg/1065 min/507 max/6035.
[1028 14:48:36.482767] 0xa01b0fa0 (Debug) BRL SUMMARY SetLock cnt/5 avg/32 min/22 max/39.
[1028 14:48:36.482772] 0xa01b0fa0 (Debug) BRL SUMMARY ClearLock cnt/55 avg/35 min/18 max/103.
[1028 14:48:36.482776] 0xa01b0fa0 (Debug) BRL SUMMARY ClearAll cnt/16 avg/28 min/12 max/58.
[1028 14:48:36.482780] 0xa01b0fa0 (Debug) BRL SUMMARY ReconDone cnt/1 avg/37 min/37 max/37.
[1028 14:48:36.482792] 0xa01b0fa0 (Debug) BRL SUMMARY RestoreLock cnt/4 avg/45 min/27 max/75.
[1028 14:48:36.482802] 0xa01b0fa0 (Debug) SG SUMMARY delrsngstgmeta space total/233.74 GB free/232.93 GB (99.65%)
[1028 14:48:36.482809] 0xa01b0fa0 (Debug) SG SUMMARY delrsngstgmeta space minfree/232.93 GB (99.65%) maxfree/232.93 GB (99.65%)
[1028 14:48:36.482813] 0xa01b0fa0 (Debug) SG SUMMARY delrsngstgmeta alloc extent cnt/0 avgsize/0.00 B.
[1028 14:48:36.482817] 0xa01b0fa0 (Debug) SG SUMMARY 305 btree free space fragments 547 splay tree fragments
[1028 14:48:36.482822] 0xa01b0fa0 (Debug) SG SUMMARY delrsngstgdata space total/2.27 TB free/2.10 TB (92.30%)
[1028 14:48:36.482828] 0xa01b0fa0 (Debug) SG SUMMARY delrsngstgdata space minfree/2.10 TB (92.30%) maxfree/2.10 TB (92.30%)
[1028 14:48:36.482832] 0xa01b0fa0 (Debug) SG SUMMARY delrsngstgdata alloc extent cnt/18 avgsize/8.00 KB.
[1028 14:48:36.482836] 0xa01b0fa0 (Debug) SG SUMMARY 3147 btree free space fragments 6172 splay tree fragments
[1028 14:48:36.482849] 0xa01b0fa0 (Debug) PIO HiPriWr SUMMARY META cnt/203 maxq/0.
[1028 14:48:36.482853] 0xa01b0fa0 (Debug) PIO HiPriWr SUMMARY META avg/506 min/278 max/1596.
[1028 14:48:36.482857] 0xa01b0fa0 (Debug) PIO HiPriWr SUMMARY META sysavg/502 sysmin/277 sysmax/1596.
[1028 14:48:36.482862] 0xa01b0fa0 (Debug) PIO HiPriWr SUMMARY META avglen/3099 minlen/512 maxlen/32768.
[1028 14:48:36.482865] 0xa01b0fa0 (Debug) PIO Read SUMMARY META cnt/5091 maxq/9.
[1028 14:48:36.482870] 0xa01b0fa0 (Debug) PIO Read SUMMARY META avg/3044 min/265 max/172422.
[1028 14:48:36.482874] 0xa01b0fa0 (Debug) PIO Read SUMMARY META sysavg/1693 sysmin/239 sysmax/56187.
[1028 14:48:36.482878] 0xa01b0fa0 (Debug) PIO Read SUMMARY META avglen/85482 minlen/512 maxlen/1048576.
[1028 14:48:36.482882] 0xa01b0fa0 (Debug) PIO Write SUMMARY META cnt/823 maxq/5.
[1028 14:48:36.482886] 0xa01b0fa0 (Debug) PIO Write SUMMARY META avg/1127 min/255 max/49630.
[1028 14:48:36.482890] 0xa01b0fa0 (Debug) PIO Write SUMMARY META sysavg/329 sysmin/247 sysmax/5629.
[1028 14:48:36.482894] 0xa01b0fa0 (Debug) PIO Write SUMMARY META avglen/2062 minlen/512 maxlen/4096.
[1028 14:48:36.482899] 0xa01b0fa0 (Debug) Cache SUMMARY [delrsngmd2.sapient.com] attrs now/180 min/1 max/180.
[1028 14:48:36.482905] 0xa01b0fa0 (Debug) VOP SUMMARY [delrsngmd2.sapient.com] Readdir cnt/5 avg/45 min/32 max/82.
[1028 14:48:36.482909] 0xa01b0fa0 (Debug) VOP SUMMARY [delrsngmd2.sapient.com] Setattr cnt/516 avg/105 min/8 max/3612.
[1028 14:48:36.482914] 0xa01b0fa0 (Debug) VOP SUMMARY [delrsngmd2.sapient.com] Remove cnt/38 avg/1280 min/542 max/6407.
[1028 14:48:36.482919] 0xa01b0fa0 (Debug) VOP SUMMARY [delrsngmd2.sapient.com] Open cnt/280 avg/70 min/17 max/2597.
[1028 14:48:36.482923] 0xa01b0fa0 (Debug) VOP SUMMARY [delrsngmd2.sapient.com] Close cnt/184 avg/35 min/17 max/141.
[1028 14:48:36.482928] 0xa01b0fa0 (Debug) VOP SUMMARY [delrsngmd2.sapient.com] PunchHoleApi cnt/4 avg/151 min/76 max/241.
[1028 14:48:36.482933] 0xa01b0fa0 (Debug) VOP SUMMARY [delrsngmd2.sapient.com] CreateV3 cnt/38 avg/5290 min/109 max/49094.
[1028 14:48:36.482938] 0xa01b0fa0 (Debug) VOP SUMMARY [delrsngmd2.sapient.com] VopLookupV4 cnt/358 avg/976 min/15 max/32093.
[1028 14:48:36.482942] 0xa01b0fa0 (Debug) VOP SUMMARY [delrsngmd2.sapient.com] VopCapNegotiate cnt/1 avg/40 min/40 max/40.
[1028 14:48:36.482947] 0xa01b0fa0 (Debug) VOP SUMMARY [delrsngmd2.sapient.com] VopClientId cnt/1 avg/21 min/21 max/21.
[1028 14:48:36.482951] 0xa01b0fa0 (Debug) VOP SUMMARY [delrsngmd2.sapient.com] GetResyncAttr cnt/142 avg/902 min/11 max/28838.
[1028 14:48:36.482956] 0xa01b0fa0 (Debug) VOP SUMMARY [delrsngmd2.sapient.com] GetLinkInfo cnt/50 avg/32 min/17 max/65.
[1028 14:48:36.482965] 0xa01b0fa0 (Debug) TKN SUMMARY [delrsngmd2.sapient.com] TokenRequestV2 cnt/2 avg/36 min/34 max/38.
[1028 14:48:36.482970] 0xa01b0fa0 (Debug) TKN SUMMARY [delrsngmd2.sapient.com] TokenRequestV3 cnt/33 avg/29 min/18 max/58.
[1028 14:48:36.482975] 0xa01b0fa0 (Debug) TKN SUMMARY [delrsngmd2.sapient.com] TokenChangeV4 cnt/450 avg/24 min/1 max/2369.
[1028 14:48:36.482979] 0xa01b0fa0 (Debug) TKN SUMMARY [delrsngmd2.sapient.com] TokenReqAlloc cnt/18 avg/1065 min/507 max/6035.
[1028 14:48:36.482999] 0xa01b0fa0 (Debug) BRL SUMMARY [delrsngmd2.sapient.com] SetLock cnt/5 avg/32 min/22 max/39.
[1028 14:48:36.483004] 0xa01b0fa0 (Debug) BRL SUMMARY [delrsngmd2.sapient.com] ClearLock cnt/55 avg/35 min/18 max/103.
[1028 14:48:36.483008] 0xa01b0fa0 (Debug) BRL SUMMARY [delrsngmd2.sapient.com] ClearAll cnt/16 avg/28 min/12 max/58.
[1028 14:48:36.483013] 0xa01b0fa0 (Debug) BRL SUMMARY [delrsngmd2.sapient.com] ReconDone cnt/1 avg/37 min/37 max/37.
[1028 14:48:36.483017] 0xa01b0fa0 (Debug) BRL SUMMARY [delrsngmd2.sapient.com] RestoreLock cnt/4 avg/45 min/27 max/75.
[1028 14:48:36] 0xb0491000 (*FATAL*) PANIC: aborting threads now.
Logger_thread: sleeps/476 signals/0 flushes/27 writes/27 switches 0
Logger_thread: logged/175 clean/175 toss/0 signalled/0 toss_message/0
Logger_thread: waited/0 awakened/0
Mac OS X (10.5.4)
Posted on Oct 28, 2010 3:09 AM