AFP/SMB Directory Listings very slow in Finder

Hello comunity!


Since the upgrade to OS X Mavericks we are experiencing server problems, browsing AFP/SMB shares on remote servers (VPN). The Directory Listing is very slow an can take up to 30 minutes for large listings.


Here's the setup


  • 2 networks are connected thanks to a VPN connection.
  • All clients, in all connected networks can communicate to a common fileserver (MacPro with OS X 10.6 SnowLeopard Server) in Network A
  • Firewall is not an issue between those networks
  • The fileserver also has other network services set up (DNS, Mailserver, SMB, AFP, Firewall, ...)
  • The clients authenticate via OpenDirectory and Kerberos to the fileserver


So the problems occur if i want to connect a client on network B to the server on network A. Connection, authentication, ... all good. Even the performance over the VPN, to tranfer files is OK. But browsing subfolders is catastrophic. I used AFP and SMB alike, results are the same.


I also made tests on older clients, to see if the fileserver is the problem. 10.6 and 10.8 clients can browse normally, speed is OK. Even Windows Clients can browse normally all the subfolders of the fileserver.


I analyzed different approaches made here, but none of them worked:

  • Connect to share with explicit port
  • Connect to share with FQDN
  • Connect to share with port 445 (SMB)
  • Setup an nsmb.conf with notify_off=yes
  • ...


I also did analyze different logs and there's something i found, but can not say if it's connected. I did see many log entries like this:

...

29.10.13 12:21:51,960 icbaccountsd[775]: -[ICBLocalDictionary writeLocalMapping:]: Status: Writing out local mapping to disk

29.10.13 12:21:51,960 icbaccountsd[775]: -[ICBLocalDictionary writeLocalMapping:]: Status: Ending writing out local mapping to disk

29.10.13 12:21:51,960 icbaccountsd[775]: -[ICBRemoteDictionary writeDevices]: Status: Writing out of devices

29.10.13 12:21:51,960 icbaccountsd[775]: -[ICBRemoteDictionary writeDevices]: Status: Ending writing out of device

...


I also saw tha a process "icbaccountsd" was often coming up an using all of my CPU, when i start browsing the share. Thus i could not find any documentation on it.


So my question: What can I do to accelerate the browsing of my AFP/SMB shares for all my Mavericks clients? What can I do to speed up the Directory Listing? And yes: i know about solutions like PathFinder, TotalFinder, .... but i'm more interested in a native solution to this problem.


Thx!!

OS X Mavericks (10.9), 10.6.8 Server

Posted on Oct 29, 2013 4:30 AM

Reply
183 replies

Oct 13, 2015 1:51 PM in response to TenjuZenjin

I've read through this thread in hopes that someone would cover "searching" SMB shares on a Windows server. We are having issues when trying to search. The speed itself of navigating the shares is fast enough, but trying to search is basically nonexistent due to how slow it is.


I've added the Volume as a spotlight index via the mdutil terminal command. That has allowed for some searching, but does not function as a true search, as it won't find certain things (Folders, files, etc) I'm not sure if it's still indexing (nothing going on via the spotlight icon) or what if it's doing anything.


Anyone have similar issues, or experiences?


Thanks,


Jason

Oct 13, 2015 2:13 PM in response to jmdeike

Unless something has changed in 10.11 that I am not aware of, you can only do file name searching of network shares, not content searching, which may be why you have limited results. Spotlight is only supported on AFP shares, or network shares from a Mac server. Since Windows servers do not use Spotlight indexing, you rarely get dependable searching. If you use a Windows server, try Extreme Z-IP to create AFP shares on your server for full Spotlight indexing.

Nov 19, 2015 6:23 AM in response to BobHarris

Interesting. Until today, I thought SMB and Samba are the same thing. Anyway, linux and windows machine work a lot better than Mac with my NAS. I understand why it doesn't work well, but it's not a good excuse. Considering SMB/Samba are widely used in the consumer market and that Apple plans to drop AFP support, it should work a lot better than it does now.

Nov 19, 2015 7:05 AM in response to Kiwiro

Samba has been tuned for many many years (at least 15 or 20), and it is often what runs on other open source platforms. And until a few years ago it was distributed as part of OS X. But then Samba changed its license to explicitly exclude distributing the software with any closed source packages (Apple, and other commercial Unix operating systems).


But the license changes do not exclude you. You are allowed to install Samba on your Mac if you desire. It is only Apple that cannot install it for you.


As for performance, it is not easy getting a network file system working efficiently (speaking as someone that worked on an AFP implementation for OpenVMS back in the late '80s and early '90s).


Yes, it would be nice if Apple's CIFS/SMB implementation worked well with Windows. Suggest you provide Apple with feedback for you needs

as it is possible Apple is mostly testing against Macs and less so against Windows and Samba implementations on other platforms. After all, they are selling Macs, not Windows, Linux, Solaris, AIX, HP-UX, etc... 🙂


Nov 19, 2015 7:33 AM in response to Kiwiro

Hi Kiwiro, what're the typical speeds you're getting from OS X and Windows VMs? Is it better when not using VPN?


I've been using the default (SMB2) from El Capitan to access Windows 8/10 shares on the same Gigabit ethernet and I get 80-110MB/s read/write speeds (typically for files larger than a 2GB). I did make the changes suggested in https://discussions.apple.com/thread/5500165?answerId=25626139022#25626139022 after I experienced terribly slow browsing in 10.9.3.

Nov 19, 2015 9:54 AM in response to nkalvi

On the work NAS (qnap), to which I can connect through VPN only, I get 1 MB/s both on Mac and on Windows 7 VM. That's the upload speed limit of the NAS. Finder crashed 2 times till I got to the test file.

On the home server, I got 20 MB/s from Mac and 25 MB/s from Win VM. 25-30 MB/s is the server's limit (an old dell laptop).


My home server is on Linux so I can't use the solution from the link.

Nov 23, 2015 11:48 PM in response to nkalvi

Hello All, wasted a good few days checking every possible reason why SMB shares are slow to access on OSX 10.11.x (and possibly before but not wasting more time)


Tried Samba on multiple NAS distros and Windows vanilla SMB file sharing... nada Tried downgrading server versions smb nt/v1, smb v2, and applied tests of recommended OSX smb/nsmb.conf testing, excluding spotlight from indexing volumes, changing finder views, changing finder display thumbnails/previews, nothing improves the slow smb browsing speeds.


Here is a great document on finder's behaviour on a network http://www.emc.com/collateral/TechnicalDocument/docu51273.pdf - very specific and looks like EMC had a hard time getting things to work with there SAN/Storage tech also.


Two machines side-by-side, one is win 7, other OSX 10.11.x i5 macbook, browse a network share with more than 100 objects... win7 near instant, OSX poor and un-productive content loading, wait anywhere between 20sec to 5min for larger folders.


In OSX, browse the same SMB mount via terminal, instant results, no delays in fetching file names, size (e.g.# ls /Volumes/smbShareName/dir1), this is not a smb version issue or size of folder. Its finder!


Makes me really sad that Apple made finder resource hungry for network volumes, whats even worse is the latest Office 2016 only supports the SMB protocol and AFP left with various user issues like opening re-corrupt files (when they are fine via slow OSX smb access).


For the love of G*#, Apple give use a network optimised finder... you want to get on the SMB bus, put the wheels back underneath so we can start rolling forward as I cannot support Mac in a business environment much longer.

This thread has been closed by the system or the community team. You may vote for any posts you find helpful, or search the Community for additional answers.

AFP/SMB Directory Listings very slow in Finder

Welcome to Apple Support Community
A forum where Apple customers help each other with their products. Get started with your Apple Account.