Backup 1 side of RAID to the other (incrementally?)

I searched the forum the answer, I'm sorry I didn't find it.

We have an Xserve RAID with both sides full of drives and each side RAIDed. Works great. We're only using one side, though, the idea was that we'd back up to the other side.

We have about 1.3 TB of data that needs to be kept backed up, though most of the data isn't changing regularly so it seems incremental backups would be the way to go so I don't back up all 1.3 TB every night.

As a test I tried Dobry Backuper and set it to do an incremental backup of a folder containing 80+ GB of data, but each time it ran it created a .tar file 80+ GB in size. I would expect that a backup of an 80GB folder that doesn't change much would have an intial backup of 80GB then subsequent runs would be small and only contain changes. But I know that the makers of Dobry Backuper are smarter than I am so I assume I did something wrong.

What would be the best way to set up a backup scenario like this? Which software would you recommend?

Thank you.

MacBook Pro, Mac OS X (10.5.1), Keyboard protected with leather

Posted on Nov 28, 2007 7:18 AM

Reply
13 replies

Nov 28, 2007 7:36 AM in response to Donald Kok

Donald Kok wrote:
don't you want your backup offsite?


Ideally.

Perhaps I should be looking at a system that backs up nightly to the other side of the RAID then weekly backsup to a large Firewire external drive?

Based on my post I want incremental, right? Otherwise I'm repeatedly backing up hundreds and hundreds of GBs that aren't changing.

Anyway, I'm looking for advice. Thank you.

Nov 28, 2007 11:51 AM in response to Wes Plate

It depends on what you really want. You say you want incremental. Beacuse of a full copy takes too long.

+ rsync copys only the changes, so time is proporional to the amount of change.
+ a incremental will also copy the changes, but in this case you can go back to a certain time and recover to the situation on that time. I do not know a simpple command tool which does this. The big backup software vendors (omniback, legato, ...) have it.

You decide what you need, and invest from that.

Nov 28, 2007 12:58 PM in response to Wes Plate

Donald your signature text certainly supports your bias

You are right about that. After 10 years of unix/linux I am doing OSX things for some time. Some of the GUI's are OK, but the xsan gui is not one of them. My primer task is administrating xsan. Hence my signature. It is not ment to offend, but to point individuals in the direction of the command line tools. Sometime I feel like I am the only cli guy in the forum.

Anyway
My idea of a backup would be a cron/launcd script which starts a rsync job.
My script is published in http://discussions.apple.com/thread.jspa?messageID=5966562&#5966562

Regards
Donald

Nov 28, 2007 1:21 PM in response to Donald Kok

I'm so glad we don't have Xsan.

I'm very much a GUI guy. While I have to administer our network and I enjoy it, I'm not very UNIXy.

🙂

You obviously know your stuff, maybe you can advise me your philosophy of the best way to back up 1.3+TB of data?

Rsync or "something like it" weekly to a 2TB external drive like this?
http://www.lacie.com/products/product.htm?pid=10351
(even though I'm generally anti-LaCie)

Dec 3, 2007 8:32 AM in response to don montalvo

Yes, 3 of 4 of some 500GB Lacies I bought a few years ago died. I do not care for Lacie since.

My thought was that if I backed up one side of the RAID to the other side, that would give me more in-house protection against failure.

Then for offsite backups I would need something else.

I am still looking for answers to the questions raised by this thread.

Dec 3, 2007 8:58 AM in response to Wes Plate

Maybe I'm missing something but if you need incremental back-ups and off-site back-ups to run as well why not a commercial back-up program? That is pretty much their entire function.

Get one that supports Disk to Disk imaging and use it for both your local incrementals and then your off-site tape or disk or whatever you want to use there. You can mess around with rsync and tar and scripts running off of cron and all that but if you care enough to actually back-up your data I think it's one of those places that it makes sense to spend some money to get that peace of mind.

My $.02,

=Tod

Dec 3, 2007 10:20 AM in response to Wes Plate

You're right - I've been reading updates to the thread but hadn't read the original in a while... 😉

Some of this depends on your off-site back-up method. I would suggest tape in general but especially for >1TB of data. (Lugging disks around is not my idea of a real back-up protocol.) Tape systems usually come with some stock kind of software and if it will do disk-to-disk then you should be pretty much set.

If you're determined to roll your own solution I would start by dis-recommending Retrospect. Stay far, far away from this once great software. The two most commonly mentioned solutions in conjunction with the Xserve RAID are bakbone's NetVault (expensive) and Tolis' BRU software.

We use BRU and it works well enough but it definitely has some sharp edges and it's own quirks. It is essentially a GUI tool to extensive Unix commands underneath and will require more work from you than you might want. Like if you want to completely restore a drive to it's last back-up state but have done only incremental back-ups (with no differential) you will need all of the incremental saves and will probably be doing them by hand because there's no simple "Restore" button. Your set-up is pretty straightforward so maybe you will stress BRU less than we do but I can't wholeheartedly recommend it - especially as an easy or turnkey solution.

I priced NetVault and it was too expensive at the time - mostly because we needed 25 clients. Once we get our clients to 10.5 and the workstations can use TimeMachine our number of required licenses will plummet and I am looking to move to NetVault then.

My (additional) $.02,

=Tod

Dec 3, 2007 4:51 PM in response to Wes Plate

Tape formats for back-up is a discussion that comes close to religious wars but in reality there are only a couple of contenders. Most people come down in the LTO (3 or 4), DLT (several variations) or AIT camps. Each format has it's adherents and detractors but essentially each generation doubles the capacity of the previous one (like LTO-3 to LTO-4) and once you've picked one you stick with it. Most of the formats are capable of native storing in the range of 500-1000GB on a tape these days and that's really where you want to be because having a back-up fail because you weren't there to swap a tape is no good.

Most tape units come in either SCSI or fibre channel so you'll need either a SCSI card installed or an open fibre channel port either on the machine or on a fibre channel switch. (There are some firewire versions out there but when you start to break a TeraByte of data you need to keep reasonable through-put in mind or your back-ups will simply take too long.) Many units now also come with a robot loader system that allows un-attended tape swapping for large back-ups and the capability of multiple drive units for simultaneous operations. Most drive units come with some software and you need to evaluate whether it is sufficient for your needs or whether you'll need to buy something more capable.

As always it's features and speed versus price and don't forget to budget for tape expenses as time goes on you'll need to add tapes and those costs add up as well.

=Tod

This thread has been closed by the system or the community team. You may vote for any posts you find helpful, or search the Community for additional answers.

Backup 1 side of RAID to the other (incrementally?)

Welcome to Apple Support Community
A forum where Apple customers help each other with their products. Get started with your Apple Account.