iCal server migration stops with exception on a directory

Question

Level 1

0 points

iCal server migration stops with exception on a directory

Hello,

I've updated my Snow Leoparc server mac mini to Lion server. But the ical service don't manage to migrate my user from diskfiles to postgres.

when I look in the /var/log/caldavd/error.log, I find this that seems revelent:

2011-10-29 23:48:39+0200 [-] [txdav.common.datastore.util.UpgradeDatabaseSchemaService#warn] Database schema check complete, launching database service.

2011-10-29 23:48:39+0200 [-] [txdav.common.datastore.util.UpgradeToDatabaseService#warn] Beginning filesystem -> database upgrade.

2011-10-29 23:48:39+0200 [-] [txdav.common.datastore.util.UpgradeToDatabaseService#warn] Migrating calendar UID '4C33B718-6499-456A-A01D-18B5EBFFBBF8'

2011-10-29 23:48:39+0200 [Uninitialized] [twistedcaldav.memcachepool.MemCacheClientFactory#error] MemCache connection failed: [Failure instance: Traceback (failure with no frames): <class 'twisted.internet.error.ConnectionRefusedError'>: Connection was refused by other side: 61: Connection refused.

]

2011-10-29 23:49:02+0200 [-] Unhandled error in Deferred:

2011-10-29 23:49:02+0200 [-] Unhandled Error

Traceback (most recent call last):

File "/System/Library/Frameworks/Python.framework/Versions/2.7/Extras/lib/python/twi sted/internet/defer.py", line 388, in errback

self._startRunCallbacks(fail)

.... ..... ....

File "/usr/share/caldavd/lib/python/txdav/caldav/datastore/file.py", line 682, in retrieve

protocol.dataReceived(self._path.getContent())

File "/System/Library/Frameworks/Python.framework/Versions/2.7/Extras/lib/python/twi sted/python/filepath.py", line 140, in getContent

fp = self.open()

File "/System/Library/Frameworks/Python.framework/Versions/2.7/Extras/lib/python/twi sted/python/filepath.py", line 519, in open

return open(self.path, mode + 'b')

exceptions.IOError: [Errno 21] Is a directory: '/Library/Server/Calendar and Contacts/Documents/calendars/__uids__/4C/33/4C33B718-6499-456A-A01D-18B5EBFFBBF 8/dropbox/000C17BD-F74F-43AE-B69F-5F20BAFBB2FE.dropbox'

And when I look at this users, he has a lot of empty directories (with .dropbox suffix") in the dropbox directory.

I've try to stop the calendar with 'serveradmin stop calendar' , remove all the directories in the dropbox, and restart to relaunch the migration. But the empty directories automagically reappears, and the migration fail the same way.

Is someone has a clue on how I can force the migration ?

Regards,

Marc

Posted on Oct 30, 2011 11:52 AM

Reply

Answer 1

Oct 30, 2011 1:50 PM in response to mcarmier

Hello mcarmier!

I had the same problem and solved it by removing files from the filesystem that do not belong to ical-service.

If i understand you right, you removed files and folders from ical-file-tree but they reapear?

Did you stop the ical server?

Bye,

Christoph

P.S. here is what helped me

https://discussions.apple.com/thread/3436728?tstart=60

Reply

Answer 2

mcarmier Author

Level 1

0 points

Oct 30, 2011 3:10 PM in response to Christoph Ewering1

Hello,

The problems seems to be lightly different here, because the 'files' on which the error are reported are empty directories all in /Library/Server/Calendar and Contacts/Documents/calendars/__uids__/*/*/*/dropbox

Theses directories are named like a GUID suffixed by .dropbox extension, there are all empty.

It seems the migration service only wants files, and there not.

Since they're empty, I've done the following procedure

sudo serveradmin stop calendar

sudo rmdir '/Library/Server/Calendar and Contacts'/Documents/calendars/__uids__/4C/33/4C33B718-6499-456A-A01D-18B5EBFFBB F8/dropbox/*.dropbox

sudo serveradmin start calendar

And the /var/log/caldavd/error.log contain the same messages, and the directories removed by the rmdir command are again in the same place.

I've tried to do a find with the name of one of theses directories and I found only one occurence in the whole disk, where I've tried to remove it.

Each of theses directories has a sort of GUID, for each of them, I found a file called with the same GUID suffixed by .ics in subdirectories of the __uid__/4C/33/4C33...../

All the events has been created by ical client 3,4 or 5. May be the directories are created by the ical server itself when using files but are not in usage after.

I'm looking to do the migration without starting the server, but I didn't find a way to do this.

Regards,

Marc

Reply

Answer 3

Oct 31, 2011 8:01 AM in response to mcarmier

We will need to go through a series of steps to try and pinpoint the problem.

First try this in terminal.app:

ls "/Library/Server/Calendar and Contacts/Documents/calendars/__uids__/4C/33/4C33B718-6499-456A-A01D-18B5EBFFBBF 8/"

What does that report?

Reply

Answer 4

mcarmier Author

Level 1

0 points

Oct 31, 2011 9:04 AM in response to Cyrus Daboo

Hello,

This give me the following directories list :

drwxr-x---@ 366 _calendar _calendar 12444 Oct 23 12:07 0F019132-F6C4-4140-A422-19ABF26A607C

drwxr-x---@ 148 _calendar _calendar 5032 Jul 30 20:26 1526C9BF-8028-4ED2-89F7-27E11F13B67D

drwxr-x---@ 132 _calendar _calendar 4488 Oct 25 11:29 38113B24-69E3-4810-A735-26696AF2CB4B

drwxr-x---@ 6 _calendar _calendar 204 Apr 7 2010 3E74C170-3299-4E15-A610-3316EE9EDEA2

drwxr-x---@ 51 _calendar _calendar 1734 Sep 5 14:15 603EFC4A-62EF-4946-904C-36E198478171

drwxr-x---@ 47 _calendar _calendar 1598 Aug 7 22:05 6B1F19B9-3C37-4A8B-9D6D-FC9A3535ADFE

drwxr-x---@ 18 _calendar _calendar 612 Aug 18 22:52 6D884DC2-D1BB-4591-9D49-CAC616237192

drwxr-x---@ 14 _calendar _calendar 476 Oct 23 12:08 72486A1B-FDA5-4750-A7AA-CBA8D9156BAC

drwxr-x---@ 558 _calendar _calendar 18972 Oct 26 12:52 82C678BC-E5C4-4555-AB0B-B83BFC74B0B5

drwxr-x---@ 8 _calendar _calendar 272 Feb 8 2011 8BF177C2-E952-4183-A057-A4467E6C0B5A

drwxr-x---@ 110 _calendar _calendar 3740 Sep 6 19:45 9F37280B-787C-428F-A719-46362E0474E8

drwxr-x---@ 44 _calendar _calendar 1496 Jun 21 2010 AB27D0EC-AC52-4EB8-85D0-0C916F651477

drwxr-x---@ 24 _calendar _calendar 816 Sep 6 19:48 B2693C44-08F5-4EA3-9900-778E5FEE60F7

drwxr-x---@ 90 _calendar _calendar 3060 Sep 6 19:47 BB426A73-04BD-4A36-9C70-BBC33FC2FF25

drwxr-x---@ 10 _calendar _calendar 340 Jul 25 2010 BE01304F-713A-4763-8126-088701024900

drwxr-x---@ 21 _calendar _calendar 714 Oct 25 11:19 C43D7555-C1E5-4753-ACB3-8F5053260CBD

drwxr-x---@ 49 _calendar _calendar 1666 Oct 23 12:08 C5694717-CD1B-43CB-8AD4-D3280F098302

drwxr-xr-x 696 _calendar _calendar 23664 Oct 30 23:00 dropbox

drwxr-x---@ 3 _calendar _calendar 102 Apr 1 2010 inbox

drwxr-x---@ 2 _calendar _calendar 68 Apr 1 2010 outbox

For information the 4C, 4C/33 and 4C/33/4C33B7 ... directories has the same attributes.

Regards,

Marc

Reply

Answer 5

Oct 31, 2011 12:54 PM in response to mcarmier

Ah, OK a lot of calendars there. That will make trying to find the errant data a little harder. Try this in terminal.app:

cd "/Library/Server/Calendar and Contacts/Documents/calendars/__uids__/4C/33/4C33B718-6499-456A-A01D-18B5EBFFBBF 8/"

grep -R "X-APPLE-DROPBOX" *

That might result in a lot of data. If so it is probably better for you to file a bug on bugreporter.apple.com and attach the result there.

Reply

Answer 6

mcarmier Author

Level 1

0 points

Oct 31, 2011 3:12 PM in response to Cyrus Daboo

OK,

I obtain :

6B1F19B9-3C37-4A8B-9D6D-FC9A3535ADFE/1CB9E8CB-B9CB-436B-862D-3872E7177B16.ics:X- APPLE-DROPBOX:

6D884DC2-D1BB-4591-9D49-CAC616237192/207BA24E-924E-4197-B46A-72D64DE8BD63.ics:X- APPLE-DROPBOX:

82C678BC-E5C4-4555-AB0B-B83BFC74B0B5/471AB8D9-881D-48B3-AFB9-681F8DCAF75D.ics:X- APPLE-DROPBOX:/calendars/__uids__/4C33B718-6499-456A-A01D-18B5EBFFBBF8

82C678BC-E5C4-4555-AB0B-B83BFC74B0B5/D27E4C9C-3FDD-47DE-A2C9-CC26F6BA64C2.ics:X- APPLE-DROPBOX:/calendars/__uids__/568F267E-4CD1-4C43-B82A-9842A48F3C00

9F37280B-787C-428F-A719-46362E0474E8/6D63E6C4-653D-466E-A2F3-10BEE19B13EE.ics:X- APPLE-DROPBOX:/calendars/__uids__/568F267E-4CD1-4C43-B82A-9842A48F3C00

After removing theses events and restarted the caldavd service, the migration was OK.

Thanks a lot for the help.

Regards,

Marc

Reply