rsync errors when syncing from linux centos 5.1

Question

Level 1

4 points

rsync errors when syncing from linux centos 5.1

I run this command to sync from linux directories to apple pc:

rsync -arv --exclude-from="/Users/blwegrzyn/exclude.txt" --delete root@192.168.1.231:/shared3/ /DATA_BACKUP

during the copy i see files being copied
and if i run it again i see same files being copied again
so around 1% or less was not copied correctly

it looks like there are some special characters that macos does not like

what is the proper way to do rsync so files are copied correctly from linux to apple ? When I copy linux to linux i dont have any issues.

thx

Bart

Mac OS X (10.6.5)

Posted on Jan 4, 2011 7:33 PM

Reply

Answer 1

BobHarris

Level 9

53,405 points

Jan 4, 2011 8:07 PM in response to bwspot

Most likely candidate would be that Mac OS X is case insensitive, so if you have FRED.txt and fred.txt, Mac OS X thinks that this the same file. So you would keep replacing fred.txt with FRED.txt and then replacing FRED.txt with fred.txt.

Colons can be an issue as well.

By the way, Terminal, Unix, and command line command questions (such as rsync) are best asked in the Mac OS X Technologies > Unix Forum
<http://discussions.apple.com/forum.jspa?forumID=735>

Also you may want to consider getting the most recent rsync.
<http://samba.anu.edu.au/rsync/>

You can also get a Mac OS X compiled rsync recent version as part of Carbon Copy Cloner, if you search under the CCC.app directory.

Reply

Answer 2

bwspot Author

Level 1

4 points

Jan 4, 2011 9:30 PM in response to bwspot

i tried the ccc version and same thing
i even complied the newest version
it looks like i dont have a choice and i will have to rename all files that dont work unless somebody here knows the magic

Reply

Answer 3

BobHarris

Level 9

53,405 points

Jan 5, 2011 6:01 AM in response to bwspot

Can you give us examples?

As I said, Upper and Lower case are meaningless on Mac OS X, so pushing a Linux file system which is case sensitive and has files in the same directory which have the same spelling, but different case to Mac OS X can cause issues.

I do not do international characters sets, so I do not know how Mac OS X handles characters with diacritical marks, if they are part of the cases insensitive file names.

Reply

Answer 4

bwspot Author

Level 1

4 points

Jan 5, 2011 8:12 AM in response to bwspot

for example directory that has character:
(2006) VÃ¶lkerball

cannot be copied and every time i run rsync it tries to copy it again

when i look at the destination folder I see that the directory actually was copied, but when i run rsync again , rsync deletes that directory and starts over

if i remove special characters it works

i found this post:
http://www.xelon.it/articles/rsync-mac-linux-windows/

so maybe the iconv is the switch that need to be used?
i cannot tell cause my centos is not compliled with iconv
i already compiled it for mac with iconv switch so i need to try on my linux to enable it and maybe it will solve the problem

Reply

Answer 5

bwspot Author

Level 1

4 points

Jan 5, 2011 8:16 AM in response to bwspot

there is an explanation for this here:
http://rsync.samba.org/FAQ.html
--iconv is the solution

i need to try

Reply

Answer 6

bwspot Author

Level 1

4 points

Jan 8, 2011 10:43 PM in response to bwspot

so i ended up with:

/usr/local/bin/rsync --iconv=UTF8-MAC,UTF-8 -arv --exclude-from="/Users/blwegrzyn/exclude.txt" --delete root@192.168.1.251:/shared3/ /DATA_BACKUP

the option --iconv=UTF8-MAC,UTF-8

did the trick

thx

Reply