icloud issues, brctl log files and privacy

Question

Level 1

7 points

icloud issues, brctl log files and privacy

Hey all,

I work on three computers and the prospect of syncing them with macOS Sierra in a multi-directional way was a nice new feature for me. Transfer of the first 140 GBs (1TB subscription) went smoothly albeit not really fast. Then things got stuck, so that every day perhaps only 10 files a 1 MB are transferred since probably three weeks. As for transfer strategy, the bulk of data is uploaded from this iMac with a very good connection to the internet. From the other computers I transferred only few files, and they are ok on every Mac. Changing files on the unaffected Macs leads to arriving almost instantly on the affected one, so this direction works.

I tried everything I could find on the web, including restarting, resetting RAMs, signing in/out, stopping timemachine, removing external drives... . I completely wiped everything and started from scratch (I originally copied everything into the icloud folder with rsync -av, so this was easily doable). The same. I assume there are some corrupt/incompatible files that mess things up. I did not try to delete the icloud database in the Library yet, I hoped that this is not required, since I don't really know what will happen if doing so and whether this would wreck the system completely.

When logging the sync with

brctl log -s --wait

I encounter a lot of errors, beside some warnings that also happen now and then on the good Macs. Mostly like this every 2 mins:

[ERROR] 235.689 [2016-12-01 13:28:15.673] send metadata error: <private>

[ERROR] 235.838 [2016-12-01 13:28:15.822] Sync: requestID:4066 failed sending: <private>

Due to the new privacy regulations of macOS, it is not possible to track down which files are affected and clogging the process. I tried to make an rsync --dry-run to check which files are missing, but it's still thousands that do, so no help here in finding the bad ones.

Has anyone a suggestion how to enable the brctl log to include file and path information so that I can take care of these files? I tried to use sudo, but does'nt change a thing. Why is Apple censoring logs that are not written into files but called directly?

Will appreciate any advice. Thanks in advance,

Chi

iMac + MacBookPro, null

Posted on Dec 1, 2016 5:00 AM

Reply

Answer 1

Dec 26, 2016 1:20 AM in response to ChiRas

hi, I also encounter this problem recently. I first add my desktop and documents folders into iCloud Drive through the iCloud setting panel. And then I added a folder which contains programs I developed. iCloud first uploaded almost all of the ~15GB files, but after that, another ~800M files needed to upload showed up.

I have check the log through brctl, and got some errors like you. Besides the errors you have written, I also found

16:12:16.729072 +0800 bird [ERROR] failed resolving documents folder path <private> for <private>, although it's marked in Document Scope; error 2 (<private>)

16:12:52.722142 +0800 bird [WARNING] Marking latest sync request failed because the requestIDs differ 15678 vs 15698 for <private>

16:12:57.656600 +0800 bird [ERROR] sync-down failed for <private>: <private>

16:13:56.317407 +0800 bird [ERROR] Sync: requestID:15704 failed sending: <private>

16:14:13.170356 +0800 bird [WARNING] Marking latest sync request failed because the requestIDs differ 15702 vs 15704 for <private>

16:14:27.850708 +0800 bird [ERROR] Sync: requestID:15706 failed sending: <private>

16:14:30.625142 +0800 bird [WARNING] Marking latest sync request failed because the requestIDs differ 15702 vs 15706 for <private>

16:48:04.767826 +0800 bird Starting operation <private>

16:48:04.767960 +0800 bird Invoking main for operation <private>

16:48:04.768022 +0800 bird Operation <private> enqueuing on container throttle queue

16:48:04.768143 +0800 bird Operation <private> invoking on container throttle queue

16:48:04.769895 +0800 cloudd Checking TCC authorization for bundleID:com.apple.bird with 1 proxy.

16:48:04.769954 +0800 cloudd TCC accepted a token for bundleID:com.apple.bird, proxy:<private>

16:48:04.770334 +0800 cloudd Checking TCC authorization for bundleID:com.apple.bird with 1 proxy.

16:48:04.770438 +0800 cloudd TCC accepted a token for bundleID:com.apple.bird, proxy:<private>

16:48:04.776539 +0800 cloudd Couldn't get application URLs for "com.apple.bird": <private>

16:48:05.195698 +0800 bird Operation <private> finished

16:48:05.195876 +0800 bird Finished operation <private>

16:48:10.290919 +0800 bird Generating a thumbnail for <private> for iCloud Drive (<private>)

16:48:10.291262 +0800 bird Generating a thumbnail for <private> for iCloud Drive (<private>)

16:48:10.293264 +0800 bird Could NOT generate a iCloud Drive thumbnail for <private>

16:48:10.293592 +0800 bird Could NOT generate a iCloud Drive thumbnail for <private>

Now, I can not upload any files in iCloud, including new files in the Desktop folder.

I also found some methods to force iCloud drive to upload a few files (only works in a little while), 1: kill the bird process; 2. open system preference -> click on iCloud -> uncheck iCloud Drive -> save copies.

I contacted the advisors via phone, but in the 40min conversation, they told me nothing except turning iCloud Drive off and then on and they even have no way to report this issue to the technology division.

Reply

Answer 2

Dec 26, 2016 9:11 AM in response to orthocenter

[WARNING] Progress: ignore upload for doc 622410 because its version size is equal to zero.

a lot of messages like this also show up

Reply

16:12:16.729072 +0800	bird	[ERROR] failed resolving documents folder path <private> for <private>, although it's marked in Document Scope; error 2 (<private>)
16:12:52.722142 +0800	bird	[WARNING] Marking latest sync request failed because the requestIDs differ 15678 vs 15698 for <private>
16:12:57.656600 +0800	bird	[ERROR] sync-down failed for <private>: <private>
16:13:56.317407 +0800	bird	[ERROR] Sync: requestID:15704 failed sending: <private>
16:14:13.170356 +0800	bird	[WARNING] Marking latest sync request failed because the requestIDs differ 15702 vs 15704 for <private>
16:14:27.850708 +0800	bird	[ERROR] Sync: requestID:15706 failed sending: <private>
16:14:30.625142 +0800	bird	[WARNING] Marking latest sync request failed because the requestIDs differ 15702 vs 15706 for <private>

16:48:04.767826 +0800	bird	Starting operation <private>
16:48:04.767960 +0800	bird	Invoking main for operation <private>
16:48:04.768022 +0800	bird	Operation <private> enqueuing on container throttle queue
16:48:04.768143 +0800	bird	Operation <private> invoking on container throttle queue
16:48:04.769895 +0800	cloudd	Checking TCC authorization for bundleID:com.apple.bird with 1 proxy.
16:48:04.769954 +0800	cloudd	TCC accepted a token for bundleID:com.apple.bird, proxy:<private>
16:48:04.770334 +0800	cloudd	Checking TCC authorization for bundleID:com.apple.bird with 1 proxy.
16:48:04.770438 +0800	cloudd	TCC accepted a token for bundleID:com.apple.bird, proxy:<private>
16:48:04.776539 +0800	cloudd	Couldn't get application URLs for "com.apple.bird": <private>
16:48:05.195698 +0800	bird	Operation <private> finished
16:48:05.195876 +0800	bird	Finished operation <private>

16:48:10.290919 +0800	bird	Generating a thumbnail for <private> for iCloud Drive (<private>)
16:48:10.291262 +0800	bird	Generating a thumbnail for <private> for iCloud Drive (<private>)
16:48:10.293264 +0800	bird	Could NOT generate a iCloud Drive thumbnail for <private>
16:48:10.293592 +0800	bird	Could NOT generate a iCloud Drive thumbnail for <private>