Creating OD Replica fails

Hi,

We recently had a drama with our OD master which rendered it unusable so we're now running with one of our OD replicas promoted to master.

We had two other servers which successfully bound as replicas to the new OD master but they didn't replicate following the initial replication. I converted them back to stand-alone servers and then tried to join them as replicas again.

Initially, I got the "augmented user record" error but manual removal of replica entries through Directory Utility corrected that.

However, I still can't get the servers to join as replicas. Using Server Admin, the replication process gets so far and then stops with no error message. Creating replica via command line gives the output below.

Any ideas? Is it the Kerberos realm that's killing this? I'm not using SSL anywhere and nothing has changed on the OD master since the initial replica creation.

TIA,

Stu

odreplica:~ badger$ sudo slapconfig -createreplica newodmaster.company.com diradmin

diradmin's Password:

2012-11-23 22:16:55 +0000 command: /usr/sbin/sso_util info -r /LDAPv3/ldap://newodmaster.company.com -p

2012-11-23 22:17:07 +0000 command: /usr/sbin/sso_util info -r /LDAPv3/128.56.0.201 -p

2012-11-23 22:17:07 +0000 1 Creating computer record for replica

2012-11-23 22:17:12 +0000 Added computer password to keychain

2012-11-23 22:17:12 +0000 2 Updating master's configuration

2012-11-23 22:17:12 +0000 3 Creating ldap replicator user

2012-11-23 22:17:14 +0000 command: /usr/sbin/ntpd -q -d -d -g -x -c /var/run/tmpntp.conf.newodmaster.company.com

2012-11-23 22:17:18 +0000 Removed file at path /var/run/tmpntp.conf.newodmaster.company.com.

2012-11-23 22:17:18 +0000 4 Updating local replica configuration

2012-11-23 22:17:18 +0000 5 Gathering replication data from the master

2012-11-23 22:17:56 +0000 6 Copying master database to new replica

2012-11-23 22:17:56 +0000 Removed directory at path /var/db/openldap/openldap-data.

2012-11-23 22:17:57 +0000 command: /usr/bin/tar -C / -xf /var/db/openldap/schema.tar

2012-11-23 22:17:57 +0000 Starting LDAP server (slapd)

2012-11-23 22:17:57 +0000 Waiting for slapd to start

2012-11-23 22:17:57 +0000 ...

2012-11-23 22:17:59 +0000 Stopping LDAP server (slapd)

2012-11-23 22:18:03 +0000 command: /usr/sbin/slaptest -f /etc/openldap/slapd.conf -F /etc/openldap/slapd.d

2012-11-23 22:18:03 +0000 command: /usr/sbin/slapadd -c -w -l /var/db/openldap/openldap-data/backup.ldif

2012-11-23 22:18:04 +0000 command: /usr/sbin/slapadd -c -w -b cn=authdata -l /var/db/openldap/authdata/authdata.ldif

2012-11-23 22:18:04 +0000

2012-11-23 22:18:04 +0000 slapd is running in import mode - only use if importing large data

bdb_monitor_db_open: monitoring disabled; configure monitor database to enable

2012-11-23 22:18:04 +0000 7 Starting new replica

2012-11-23 22:18:04 +0000 Starting LDAP server (slapd)

2012-11-23 22:18:05 +0000 Waiting for slapd to start

2012-11-23 22:18:05 +0000 ...

2012-11-23 22:18:06 +0000 command: /usr/bin/ldapmodify -c -x -H ldapi://%2Fvar%2Frun%2Fldapi

2012-11-23 22:18:06 +0000 command: /usr/bin/ldapsearch -x -LLL -H ldapi://%2Fvar%2Frun%2Fldapi -b cn=config -s base olcServerID

2012-11-23 22:18:06 +0000 command: /usr/bin/ldapmodify -c -x -H ldapi://%2Fvar%2Frun%2Fldapi

2012-11-23 22:18:06 +0000 command: /usr/bin/ldapmodify -c -x -H ldapi://%2Fvar%2Frun%2Fldapi

2012-11-23 22:18:06 +0000 command: /bin/launchctl load -w /System/Library/LaunchDaemons/com.apple.PasswordService.plist

2012-11-23 22:18:07 +0000 8 Enabling local Kerberos server

2012-11-23 22:18:07 +0000 Configuring Kerberos server, realm is DEADSERVER.COMPANY.COM

2012-11-23 22:18:07 +0000 command: /usr/sbin/kdcsetup -e

2012-11-23 22:18:07 +0000 command: /usr/sbin/sso_util configure -x -k -r DEADSERVER.COMPANY.COM -f /LDAPv3/ldapi://%2Fvar%2Frun%2Fldapi -a diradmin -p **** -v 1 all

2012-11-23 22:18:08 +0000 _createLDAPReplica: sso_util configure failed 1. stdout = { } stderr = { Creating the service list

Creating the keytab file

}

2012-11-23 22:18:09 +0000 9 Enabling syncprov overlay on the replica

2012-11-23 22:18:09 +0000 command: /usr/bin/ldapsearch -x -LLL -H ldapi://%2Fvar%2Frun%2Fldapi -b cn=config objectClass=olcSyncProvConfig dn

2012-11-23 22:18:09 +0000 command: /usr/bin/ldapmodify -c -x -H ldapi://%2Fvar%2Frun%2Fldapi

2012-11-23 22:18:10 +0000 adding new entry "olcOverlay=syncprov,olcDatabase={1}bdb,cn=config"

2012-11-23 22:18:10 +0000 command: /usr/bin/ldapmodify -c -x -H ldapi://%2Fvar%2Frun%2Fldapi

2012-11-23 22:18:10 +0000 adding new entry "olcOverlay=syncprov,olcDatabase={2}bdb,cn=config"

2012-11-23 22:18:10 +0000 10 Adding replica to master

2012-11-23 22:18:10 +0000 addReplica request failed with status 1073 Unknown Error

2012-11-23 22:18:10 +0000 addReplica request failed with status 1073 Unknown Error (error = 69)

2012-11-23 22:18:10 +0000 command: /bin/launchctl unload -w /System/Library/LaunchDaemons/com.apple.opendirectorybackup.plist

2012-11-23 22:18:10 +0000 Deleting Cert Authority related data

2012-11-23 22:18:10 +0000 No intCAIdentity, not removing int CA from keychain

2012-11-23 22:18:10 +0000 command: /bin/launchctl unload -w /System/Library/LaunchDaemons/com.apple.xscertd.plist

2012-11-23 22:18:10 +0000 command: /bin/launchctl unload -w /System/Library/LaunchDaemons/com.apple.xscertd-helper.plist

2012-11-23 22:18:10 +0000 command: /bin/launchctl unload -w /System/Library/LaunchDaemons/com.apple.xscertadmin.plist

2012-11-23 22:18:10 +0000 Updating ldapreplicas on primary master

2012-11-23 22:18:10 +0000 Removing self from the database

2012-11-23 22:18:11 +0000 Warning: An error occurred while re-enabling GSSAPI.

2012-11-23 22:18:12 +0000 Stopping LDAP server (slapd)

2012-11-23 22:18:16 +0000 cleanKeytab: unable to retrieve default realm

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/openldap-data/__db.001.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/openldap-data/__db.002.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/openldap-data/__db.003.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/openldap-data/__db.004.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/openldap-data/__db.005.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/openldap-data/__db.006.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/openldap-data/altSecurityIdentities.bdb.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/openldap-data/apple-company.bdb.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/openldap-data/apple-computers.bdb.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/openldap-data/apple-config-realname.bdb.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/openldap-data/apple-generateduid.bdb.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/openldap-data/apple-group-memberguid.bdb.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/openldap-data/apple-group-nestedgroup.bdb.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/openldap-data/apple-group-realname.bdb.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/openldap-data/apple-hwuuid.bdb.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/openldap-data/apple-realname.bdb.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/openldap-data/apple-serviceslocator.bdb.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/openldap-data/c.bdb.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/openldap-data/cn.bdb.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/openldap-data/DB_CONFIG.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/openldap-data/departmentNumber.bdb.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/openldap-data/dn2id.bdb.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/openldap-data/entryCSN.bdb.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/openldap-data/entryUUID.bdb.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/openldap-data/gidNumber.bdb.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/openldap-data/givenName.bdb.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/openldap-data/id2entry.bdb.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/openldap-data/ipHostNumber.bdb.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/openldap-data/l.bdb.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/openldap-data/log.0000000001.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/openldap-data/macAddress.bdb.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/openldap-data/mail.bdb.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/openldap-data/memberUid.bdb.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/openldap-data/mobile.bdb.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/openldap-data/objectClass.bdb.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/openldap-data/ou.bdb.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/openldap-data/postalCode.bdb.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/openldap-data/sn.bdb.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/openldap-data/st.bdb.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/openldap-data/street.bdb.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/openldap-data/telephoneNumber.bdb.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/openldap-data/uid.bdb.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/openldap-data/uidNumber.bdb.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/authdata/__db.001.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/authdata/__db.002.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/authdata/__db.003.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/authdata/__db.004.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/authdata/__db.005.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/authdata/__db.006.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/authdata/alock.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/authdata/authdata.ldif.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/authdata/authdata_DB_CONFIG.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/authdata/authGUID.bdb.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/authdata/DB_CONFIG.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/authdata/dn2id.bdb.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/authdata/draft-krbPrincipalAliases.bdb.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/authdata/draft-krbPrincipalName.bdb.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/authdata/entryCSN.bdb.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/authdata/entryUUID.bdb.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/authdata/id2entry.bdb.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/authdata/log.0000000001.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/openldap/authdata/objectClass.bdb.

2012-11-23 22:18:16 +0000 Removed directory at path /var/db/openldap/authdata.

2012-11-23 22:18:16 +0000 Removed file at path /etc/openldap/slapd_macosxserver.conf.

2012-11-23 22:18:16 +0000 Removed file at path /etc/openldap/slapd.conf.

2012-11-23 22:18:16 +0000 Removed file at path /etc/openldap/rootDSE.ldif.

2012-11-23 22:18:16 +0000 Removed file at path /var/db/dslocal/nodes/Default/groups/com.apple.access_dsproxy.plist.

2012-11-23 22:18:16 +0000 Removed directory at path /etc/openldap/slapd.d/cn=config.

2012-11-23 22:18:16 +0000 Removed file at path /etc/openldap/slapd.d/cn=config.ldif.

2012-11-23 22:18:16 +0000 Removed directory at path /etc/openldap/slapd.d.

2012-11-23 22:18:16 +0000 Removed directory at path /etc/openldap/slapd.d.backup/cn=config.

2012-11-23 22:18:16 +0000 Removed file at path /etc/openldap/slapd.d.backup/cn=config.ldif.

2012-11-23 22:18:16 +0000 Removed directory at path /etc/openldap/slapd.d.backup.

2012-11-23 22:18:16 +0000 command: /bin/launchctl unload -w /System/Library/LaunchDaemons/com.apple.PasswordService.plist

2012-11-23 22:18:22 +0000 Removed file at path /Library/Preferences/com.apple.openldap.plist.