Backup for tapeless media

Many film-makers have begun to shoot on tapeless media. XDCam Ex, P2, video on DSLRs, Red, AVCHD, hard disk camcorders, and such like. So, naturally, where they would store tapes in a cupboard, they now have all their 'rushes' as digital video files sitting on hard disks.

Hard disks have become larger, faster and cheaper - like they've been doing for decades now. They've also become more unreliable. Almost anyone who's shooting digital has a hard disk failure story to tell.

So what's the best way to backup this new media? A couple of approaches based on my experience.

First, estimate who much data you need to store. Red, video DSLRs, XDCam Ex, P2 all have a data rate - a certain number of Gb/hr. For instance HDV is 13 Gb pr hour, Canon 5D or 7D do 19 Gb/hr, XDCam Ex is 16 Gb/hr, Red is 98 Gb/hr and so on. So you can get a number on how many hours of your media a 500 Gb or 1 Tb hard disk can hold. Get hard disks accordingly.

In the case of Red, XDCam Ex, and video DSLRs you need to store the original media as well as the media you edited with. So that adds to the number of Gb or Tb needed.

One relatively low cost method is to get small 2.5 in. portable hard disks. These cost about Rs 6000 for 500 Gb. You get two drives of even different makes to spread the risk by making a copy on both drives. These drives can now hold you original camera media. This is not what you edit with so the drives need not be fast and so 2.5 in. drives will work just fine.

Then for the editing, get 1, 1.5 or even 2 Tb Firewire drives. If you want better speed, get a eSATA drive and fit your MacPro with a SATA card. Or if you have a MacBook Pro, you can get an Express Card adapter to use eSATA drives.

For this editing media too, store your files on two drives to reduce the risk of drive failure. Here too, I favour drives of different makes. My favorites are Western Digital and Seagate. But not LaCie.

But if you're dong this on an ongoing basis and expect a lot of data, you'll find that you end up with a stack of drives. Leading to newer storage problems.

Consider getting a RAID. This is an external case that has a bank of 4 or 5 hard disks. These disks work as one large hard disk. They are combined using some magic called RAID striping, that makes them safe.

So, in a RAID out of 4, if one disk were to fail, your data is still fully safe. All you need to do is  to replace the failed drive and the system automatically rebuilds it and fills it with data that was on the old drive.

There are many companies making safe RAIDs for editing. I'm in the process of getting one for myself and testing it for safety for tapeless media for documentaries and features.

For long term backup, consider two other mediums - Blu-ray and LTO tapes. These cost less than hard drives and last longer than disks. they don't need power to store data and read it.

Blu-Ray is great for backing up video DSLR data. One disk holds 23 Gb which compares nicely with 16 Gb memory cards that video DSLRs use. Or even SxS cards that XDCam Ex uses. Even the Red shoots to 8 or 16 Gb CF memory cards so Blu-ray can be used to back up Red files too.

Over time you'll find that you have many many blu-ray disks posing a storage problem of its own. LTOs store more than Blu-ray, typically 400 or 800 Gb per tape depending on whether it is LTO 3 or LTO 4.

To backup to LTO 3 or LTO 4, you need to buy a drive that can write to Blu-ray disk, or LTO tape. These drives cost about Rs 40k for a Blu-ray writer, and about Rs 2 lakhs for an LTO drive.

If that's out of your budget, consider getting in touch with a post facility that has these drives. They could do the backup for you on a per tape, or per Gb basis that can make it economical.

Whatever route you take, factoring the backup of your media is crucial. Digital cameras create data that represents your time and effort shooting. You lose that data just because a drive failed, usually means you've lost all your rushes. Completely avoidable with a bit of planning..

Backup without hassles

Everyone knows they have to back up their work. Nearly everyone has lost some data from drive or computer failure. Almost no one makes backups, or at least not often enough to make a difference. And when you really need a backup, the latest one is usually the only one of value. And mostly if its over a week old, its useless.

I've been in this as well and have somehow managed to find one possible solution. This is 'a' solution not 'the' solution. And I've been using it for a few months now.

Lacie Silverkeeper

It ships with every LaCie hard disk on a CD. But you can download it at the link above. And its free.

Very simple to use. Just decide which folder should be backed up. To where it has to be backed up - usually a Firewire or USB hard disk. And make a schedule for the back up. Mine is 9 am every day. Yes, every single day.

On the first day, it takes a while because all the stuff on the folder you specify is copied to the target. The next day and thereafter, only files that have changed are copied and overwritten. Overwritten, remember.

Files you delete from the folder you're backing up are deleted off the backup as well. So the backup is always an exact clone of the original. You can change this delete behaviour with one setting 'Never remove files'. I've done that. And you can specify excluded items. So I've marked 'Documents' for backup, but excluded 'Final Cut Pro Documents' from the backup.

You can decide to make multiple copies. So it you set that to 5, Silverkeeper will back up and make a new set each day, but keep 5 sets, deleting the next oldest one in rotation. I've not used this option.

Besides backing up data, a good backup solution should also help in restoring backed up data. I had occasion to test that. When I upgraded my MacBook Pro to Leopard I did 'Erase and Install'. So I lost everything - photos, music, videos, documents, Mail, FCP projects.

After Leopard installed, I just connected my backup drive and copied the backup folders in their appropriate places, and had my old MacBook back. I chose to do this manually as I wanted to pick and choose what I wanted back. Great way to get rid of clutter. But there's also a restore option that does this for you.

Very simply, LaCie Silverkeeper works. At their site LaCie say it works with Tiger up to 10.4.11, but not with Leopard. I'm using it with Leopard on my laptop. Seems to work. But then Leopard has Time Machine. I've yet to try that.

Silverkeeper only works on a Mac. For Windows, there's 1-Click also free and from LaCie. This too is on the CD that comes with every laCie drive.

Western Digital also ship backup software with their drives. I tried it
once, but I must confess I didn't give it much time since I was already using Silverkeeper and it worked for me.

Again, backup is important, everyone knows that. With Silverkeeper, the excuses to not backup just reduced by one.

Now to look for a great software to remove duplicates all over one's hard disk...