caldav does not work after upgrade from 10.6.8

Question

caldav does not work after upgrade from 10.6.8

Hello!

After upgrading two test servers from 10.6.8 to 10.7.2 with no problems i decided last night it is time to upgrade our production server.

Took sometime but everything went well except for caldav service. If I understand the log right the migration to lion-calendars crashes when the script wants to put the calendars from filesystem into a database.

After reboot the script runs into the same error.

BTW the notification service does not work also. But that is not very important.

Every help is appreciated, bye

eweri

Here is the part of the log file:

more /var/log/caldavd/error.log

2011-10-26 08:28:33+0200 [-] Log opened.

2011-10-26 08:28:33+0200 [-] twistd 11.0.0 (/System/Library/Frameworks/Python.framework/Versions/2.7/Resources/Python.app/ Contents/MacOS/Python 2.7.1) starting up.

2011-10-26 08:28:33+0200 [-] reactor class: twext.internet.kqreactor.KQueueReactor.

2011-10-26 08:28:33+0200 [-] calendarserver.accesslog.AMPLoggingFactory starting on "'/var/run/caldavd/caldavd.sock'"

2011-10-26 08:28:33+0200 [-] calendarserver.tap.caldav.CalDAVStatisticsServer starting on "'/var/run/caldavd-stats.sock'"

2011-10-26 08:28:33+0200 [-] [twistedcaldav.upgrade#warn] Upgrading to version 2

2011-10-26 08:28:33+0200 [-] [twistedcaldav.upgrade#warn] Regular collection hidden: /Library/Server/Calendar and Contacts/Documents/calendars/__uids__/13/93/139328E4-76C8-427C-AD0C-CB6D102C7D7 F/outbox

2011-10-26 08:28:33+0200 [-] [twistedcaldav.upgrade#warn] Regular collection hidden: /Library/Server/Calendar and Contacts/Documents/calendars/__uids__/21/D0/21D05230-A847-4B8D-B810-CFE793F634C B/outbox

2011-10-26 08:28:33+0200 [-] [twistedcaldav.upgrade#warn] Regular collection hidden: /Library/Server/Calendar and Contacts/Documents/calendars/__uids__/84/5E/845E1E6D-F13B-4233-A4E5-0055F085388 1/outbox

2011-10-26 08:28:33+0200 [-] [twistedcaldav.upgrade#warn] Regular collection hidden: /Library/Server/Calendar and Contacts/Documents/calendars/__uids__/B5/B6/B5B6BAA3-A5E0-4526-B7F3-15DC2811E08 3/outbox

2011-10-26 08:28:33+0200 [-] [twistedcaldav.upgrade#warn] Regular collection hidden: /Library/Server/Calendar and Contacts/Documents/calendars/__uids__/E0/2B/E02BEF32-1714-4C5B-85DF-0184DA8B313 3/outbox

2011-10-26 08:28:33+0200 [-] [twistedcaldav.upgrade#warn] Regular collection hidden: /Library/Server/Calendar and Contacts/Documents/calendars/__uids__/E2/64/E264473A-CEC7-4E1A-9756-59DE5AF62E5 0/outbox

2011-10-26 08:28:33+0200 [-] [twistedcaldav.upgrade#warn] Regular collection hidden: /Library/Server/Calendar and Contacts/Documents/calendars/__uids__/wi/ki/wiki-zm-r/inbox

2011-10-26 08:28:33+0200 [-] [twistedcaldav.upgrade#warn] Upgraded to version 2

2011-10-26 08:28:33+0200 [-] [txdav.common.datastore.util.UpgradeDatabaseSchemaService#warn] Beginning database schema check.

2011-10-26 08:28:33+0200 [-] [txdav.common.datastore.util.UpgradeDatabaseSchemaService#warn] Required schema version: 3.

2011-10-26 08:28:33+0200 [-] [txdav.common.datastore.util.UpgradeDatabaseSchemaService#warn] Actual schema version: 3.

2011-10-26 08:28:33+0200 [-] [txdav.common.datastore.util.UpgradeDatabaseSchemaService#warn] Schema version check complete: no upgrade needed.

2011-10-26 08:28:33+0200 [-] [txdav.common.datastore.util.UpgradeDatabaseSchemaService#warn] Database schema check complete, launching database service.

2011-10-26 08:28:33+0200 [-] [txdav.common.datastore.util.UpgradeToDatabaseService#warn] Beginning filesystem -> database upgrade.

2011-10-26 08:28:33+0200 [-] [txdav.common.datastore.util.UpgradeToDatabaseService#warn] Migrating calendar UID 'XXXXXXXX-07B1-4733-AE89-8728D0C2CB4A'

2011-10-26 08:28:34+0200 [-] [txdav.common.datastore.util.UpgradeToDatabaseService#warn] Migrating calendar UID 'XXXXXXXX-5E85-4CC9-902A-A101164BD83F'

2011-10-26 08:28:34+0200 [Uninitialized] [twistedcaldav.notify.NotificationClientFactory#error] Unable to connect to notification server: [Failure instance: Traceback (failure with no frames): <class 'twisted.internet.error.ConnectionRefusedError'>: Connection was refused by other side: 61: Connection refused.

]

2011-10-26 08:28:34+0200 [-] [txdav.common.datastore.util.UpgradeToDatabaseService#warn] Migrating calendar UID 'XXXXXXXX-76C8-427C-AD0C-CB6D102C7D7F'

2011-10-26 08:28:37+0200 [Uninitialized] [twistedcaldav.notify.NotificationClientFactory#error] Unable to connect to notification server: [Failure instance: Traceback (failure with no frames): <class 'twisted.internet.error.ConnectionRefusedError'>: Connection was refused by other side: 61: Connection refused.

]

2011-10-26 08:28:46+0200 [Uninitialized] [twistedcaldav.notify.NotificationClientFactory#error] Unable to connect to notification server: [Failure instance: Traceback (failure with no frames): <class 'twisted.internet.error.ConnectionRefusedError'>: Connection was refused by other side: 61: Connection refused.

]

2011-10-26 08:28:58+0200 [-] [txdav.common.datastore.util.UpgradeToDatabaseService#warn] Migrating calendar UID 'XXXXXXXX-A847-4B8D-B810-CFE793F634CB'

2011-10-26 08:28:59+0200 [-] [txdav.common.datastore.util.UpgradeToDatabaseService#warn] Migrating calendar UID 'XXXXXXXX-6E96-4671-9BEB-FAABDB623EA3'

2011-10-26 08:28:59+0200 [-] [txdav.common.datastore.util.UpgradeToDatabaseService#warn] Migrating calendar UID 'XXXXXXXX-C56A-462D-90E0-D60285CCF751'

2011-10-26 08:28:59+0200 [-] [txdav.common.datastore.util.UpgradeToDatabaseService#warn] Migrating calendar UID 'XXXXXXXX-F13B-4233-A4E5-0055F0853881'

2011-10-26 08:29:07+0200 [Uninitialized] [twistedcaldav.notify.NotificationClientFactory#error] Unable to connect to notification server: [Failure instance: Traceback (failure with no frames): <class 'twisted.internet.error.ConnectionRefusedError'>: Connection was refused by other side: 61: Connection refused.

]

2011-10-26 08:29:11+0200 [-] [txdav.common.datastore.util.UpgradeToDatabaseService#warn] Migrating calendar UID 'XXXXXXXX-A2A9-4B21-8735-577F24ABA6D5'

2011-10-26 08:29:11+0200 [-] [txdav.common.datastore.util.UpgradeToDatabaseService#warn] Migrating calendar UID 'XXXXXXXX-7A55-4B63-AC42-43151A1F4810'

2011-10-26 08:29:11+0200 [-] [txdav.common.datastore.util.UpgradeToDatabaseService#warn] Migrating calendar UID 'XXXXXXXX-F38C-489D-88A2-42B5F47BB4AD'

2011-10-26 08:29:11+0200 [-] [txdav.common.datastore.util.UpgradeToDatabaseService#warn] Migrating calendar UID 'XXXXXXXX-A5E0-4526-B7F3-15DC2811E083'

2011-10-26 08:29:12+0200 [-] [txdav.common.datastore.util.UpgradeToDatabaseService#warn] Migrating calendar UID 'XXXXXXXX-97BE-43C3-94F7-A8C99AB92425'

2011-10-26 08:29:12+0200 [-] [txdav.common.datastore.util.UpgradeToDatabaseService#warn] Migrating calendar UID 'XXXXXXXX-9C74-412D-8DC0-69E3ED918CAD'

2011-10-26 08:29:13+0200 [-] [txdav.common.datastore.util.UpgradeToDatabaseService#warn] Migrating calendar UID 'XXXXXXXX-D6BD-450E-A8A1-708C063EF05F'

2011-10-26 08:29:13+0200 [-] [txdav.common.datastore.util.UpgradeToDatabaseService#warn] Migrating calendar UID 'XXXXXXXX-EC4C-43B6-A6A8-EA02F4024EB3'

2011-10-26 08:29:14+0200 [-] [txdav.common.datastore.util.UpgradeToDatabaseService#warn] Migrating calendar UID 'XXXXXXXX-1714-4C5B-85DF-0184DA8B3133'

2011-10-26 08:29:15+0200 [-] [txdav.common.datastore.util.UpgradeToDatabaseService#warn] Migrating calendar UID 'XXXXXXXX-CEC7-4E1A-9756-59DE5AF62E50'

2011-10-26 08:29:26+0200 [-] [txdav.common.datastore.util.UpgradeToDatabaseService#warn] Migrating calendar UID 'XXXXXXXX-E113-470C-A824-0D988A8319FB'

2011-10-26 08:29:30+0200 [-] [txdav.common.datastore.util.UpgradeToDatabaseService#warn] Migrating calendar UID 'wiki-XXXXXXXX'

2011-10-26 08:29:32+0200 [-] [txdav.common.datastore.util.UpgradeToDatabaseService#warn] Migrating calendar UID 'wiki-XXXXXXXX'

2011-10-26 08:29:33+0200 [-] Unhandled error in Deferred:

2011-10-26 08:29:33+0200 [-] Unhandled Error

Traceback (most recent call last):

File "/System/Library/Frameworks/Python.framework/Versions/2.7/Extras/lib/python/twi sted/internet/defer.py", line 361, in callback

self._startRunCallbacks(result)

File "/System/Library/Frameworks/Python.framework/Versions/2.7/Extras/lib/python/twi sted/internet/defer.py", line 455, in _startRunCallbacks

self._runCallbacks()

File "/System/Library/Frameworks/Python.framework/Versions/2.7/Extras/lib/python/twi sted/internet/defer.py", line 542, in _runCallbacks

current.result = callback(current.result, *args, **kw)

File "/System/Library/Frameworks/Python.framework/Versions/2.7/Extras/lib/python/twi sted/internet/defer.py", line 1076, in gotResult

_inlineCallbacks(r, g, deferred)

--- <exception caught here> ---

File "/System/Library/Frameworks/Python.framework/Versions/2.7/Extras/lib/python/twi sted/internet/defer.py", line 1020, in _inlineCallbacks

result = g.send(result)

File "/usr/share/caldavd/lib/python/txdav/common/datastore/util.py", line 146, in doMigration

uid = fileHome.uid()

exceptions.AttributeError: 'NoneType' object has no attribute 'uid'

2011-10-26 08:30:13+0200 [Uninitialized] [twistedcaldav.notify.NotificationClientFactory#error] Unable to connect to notification server: [Failure instance: Traceback (failure with no frames): <class 'twisted.internet.error.ConnectionRefusedError'>: Connection was refused by other side: 61: Connection refused.

]

2011-10-26 08:33:19+0200 [Uninitialized] [twistedcaldav.notify.NotificationClientFactory#error] Unable to connect to notification server: [Failure instance: Traceback (failure with no frames): <class 'twisted.internet.error.ConnectionRefusedError'>: Connection was refused by other side: 61: Connection refused.

]

2011-10-26 08:42:07+0200 [Uninitialized] [twistedcaldav.notify.NotificationClientFactory#error] Unable to connect to notification server: [Failure instance: Traceback (failure with no frames): <class 'twisted.internet.error.ConnectionRefusedError'>: Connection was refused by other side: 61: Connection refused.

]

2011-10-26 09:06:13+0200 [Uninitialized] [twistedcaldav.notify.NotificationClientFactory#error] Unable to connect to notification server: [Failure instance: Traceback (failure with no frames): <class 'twisted.internet.error.ConnectionRefusedError'>: Connection was refused by other side: 61: Connection refused.

]

2011-10-26 09:44:28+0200 [-] Received SIGTERM, shutting down.

2011-10-26 09:44:28+0200 [-] (UNIX Port '/var/run/caldavd-stats.sock' Closed)

2011-10-26 09:44:28+0200 [-] (UNIX Port '/var/run/caldavd/caldavd.sock' Closed)

2011-10-26 09:44:28+0200 [-] Main loop terminated.

2011-10-26 09:44:29+0200 [-] Server Shut Down.

2011-10-26 09:46:13+0200 [-] Log opened.

2011-10-26 09:46:13+0200 [-] twistd 11.0.0 (/System/Library/Frameworks/Python.framework/Versions/2.7/Resources/Python.app/ Contents/MacOS/Python 2.7.1) starting up.

2011-10-26 09:46:13+0200 [-] reactor class: twext.internet.kqreactor.KQueueReactor.

2011-10-26 09:46:13+0200 [-] calendarserver.accesslog.AMPLoggingFactory starting on "'/var/run/caldavd/caldavd.sock'"

2011-10-26 09:46:13+0200 [-] calendarserver.tap.caldav.CalDAVStatisticsServer starting on "'/var/run/caldavd-stats.sock'"

2011-10-26 09:46:13+0200 [-] [txdav.common.datastore.util.UpgradeDatabaseSchemaService#warn] Beginning database schema check.

2011-10-26 09:46:13+0200 [-] [txdav.common.datastore.util.UpgradeDatabaseSchemaService#warn] Required schema version: 3.

2011-10-26 09:46:14+0200 [-] [txdav.common.datastore.util.UpgradeDatabaseSchemaService#warn] Actual schema version: 3.

2011-10-26 09:46:14+0200 [-] [txdav.common.datastore.util.UpgradeDatabaseSchemaService#warn] Schema version check complete: no upgrade needed.

2011-10-26 09:46:14+0200 [-] [txdav.common.datastore.util.UpgradeDatabaseSchemaService#warn] Database schema check complete, launching database service.

2011-10-26 09:46:14+0200 [-] [txdav.common.datastore.util.UpgradeToDatabaseService#warn] Beginning filesystem -> database upgrade.

2011-10-26 09:46:14+0200 [-] Unhandled error in Deferred:

2011-10-26 09:46:14+0200 [-] Unhandled Error

Traceback (most recent call last):

File "/System/Library/Frameworks/Python.framework/Versions/2.7/Extras/lib/python/twi sted/application/service.py", line 184, in setServiceParent

self.parent.addService(self)

....

Mac mini, Mac OS X (10.7.2)

Posted on Oct 26, 2011 4:38 AM

Reply

Answer 1

Oct 26, 2011 7:00 AM in response to Christoph Ewering1

Just to let everybody know what I am trying at the moment:

Found a thread where someone suggests to delete the postgresql-database:

Detials in this thread https://discussions.apple.com/thread/3206720?start=0&tstart=0

1. sudo serveradmin stop calendar addressbook

2. copy old 10.6.8 calender data from backup ("../Library/CalendarServer/Documents/") to /Library/Server/Calendar\ and\ Contacts/Documents/

3. delete database: sudo dropdb -U _postgres caldav

4. mv (if it exists) /Library/Server/Calendar\ and\ Contacts/Documents/calendars-migrated to /Library/Server/Calendar\ and\ Contacts/Documents/calendars-migrated-old

5. sudo calendarserver_bootstrap_database

6. now we start again: sudo serveradmin start calendar

7. watch the log file - tail -f /var/log/caldavd/error.log

And I get the same error as above but now I see a new one:

2011-10-26 15:29:19+0200 [Uninitialized] [twistedcaldav.memcachepool.MemCacheClientFactory#error] MemCache connection failed: [Failure instance: Traceback (failure with no frames): <class 'twisted.internet.error.ConnectionRefusedError'>: Connection was refused by other side: 61: Connection refused.

]

Every help is welcome, bye

Christoph

Reply

Answer 2

_morgen__

Level 1

140 points

Oct 26, 2011 8:58 AM in response to Christoph Ewering1

I think the issue is the same as from another thread. You probably have a stray file sitting in /Library/Server/Calendar and Contacts/Documents/__uids__/wi/ki/

Reply

Answer 3

Oct 26, 2011 12:45 PM in response to _morgen__

Hello ~morgen!

Your are right and that was me in the other thread.

My problem was solfevd as I moved away an old tar-archiv that was still sitting there from and old test.

So keep the file structure tidy 😉

Okay this problem is solved lets fix the next one.

Bye,

Christoph

Reply