Toolbox
Share on facebook Reddit del.icio.us Save to Yahoo! bookmarks Slashdot it Save to Windows live Save to MySpace science news feed Add to google
- size +

Not enough space: The dicey game of storing, backing up files

By Troy Wolverton, Technology / Other
About five years ago, a technical disaster struck Fernando Santos: His computer hard drive failed. The San Francisco resident lost everything on it and had to reformat his drive. "I lost a lot of nice pictures," said Santos, 20.

Wade Mengel, a Milbrae, Calif., resident and amateur photographer, has taken steps to make sure the same fate doesn't happen to him. He backs up his digital photo collection on an external hard drive and on duplicate DVDs.

But Mengel has his own digital storage issue. His photo collection is massive - about 1 terabyte worth. And with his new camera taking pictures that are about 5 megabytes each, there's no room left on his computer's hard drive to store them all.

"It really adds up quick," said Mengel, 32.

The experiences of Mengel and Santos point to the problems and perils of the digital age. As consumers replace CDs, videotapes and film with digital files, they must wrestle with managing potentially massive amounts of data. Most store that data and media on hard drives, which can be a risky choice, as Santos found out.

Unfortunately, the situation is likely to get worse before it gets any better. More people are creating or buying increasing amounts of digital media without any ideal solution on the horizon for safely housing all that data for the long term.

"There is a big question of, 'Where are you going to put this stuff?' and 'What's the fault tolerance (of the device you store it on)?'" said Randy Giusto, an analyst who covers consumer technology for research firm IDC.

Consumers have a number of choices for storing and backing up their digital files, but none of them are ideal. Backing information up to external hard drives can be difficult and prone to the same failure rates as internal hard drives. Flash memory-based drives are considered to be more reliable, but are far more expensive.

Optical discs such as DVDs and CDs are cheap, but they hold relatively little data and can be ruined by scratches. Online backup can protect against local disasters, such as a fire, but Internet transfer rates tend to be dauntingly slow for large files.

Mengel's not alone in needing ever-increasing amounts of space to store his digital files. Parks Associates expects that by 2012, tech-savvy consumers with broadband connections in their homes will be storing some 900 gigabytes worth of data - whether that's television shows on their DVR, movies they've downloaded from the Internet, photos they've taken or digital songs they've bought. That's up from 180 gigabytes last year and just 50 gigabytes in 2005.

MortgageMarvel.com, a technology research firm. That's up from 263 million drives with an average capacity of 58 gigabytes in 2003.

Consumers have turned to hard drives because the prices have fallen sharply over time and they are now relatively inexpensive. You can find a terabyte drive these days for less than $200. Just a few years ago, that drive would have easily been $1,000 or more.

A hard drive "is the cheapest place to put stuff, but it's far from the safest," said Rob Enderle, principal analyst with the Enderle Group, a technology consulting firm.

Indeed, while the hard-drive industry has touted the device's reliability, recent studies indicate that, on average, 2 percent to 4 percent of hard drives fail in a given year and some batches may be much less reliable than that.

"You're talking about an imperfect device that you're keeping your precious memories on," said Josh Martin, a senior analyst at the Yankee Group, a technology research and consulting firm. "It's like playing Russian roulette with your memories."

That risk threatens even the most conscientious users, those who back up their files regularly. And there aren't many of those. Parks Associates found that just 10 percent of households regularly back up their digital files. While Apple has incorporated backup software into its Mac OS and many external hard drive makers include the software with their drives, backing up data is still too complex a task for most consumers, analysts say. That's a problem, because that data could be fried by any kind of disaster, from a spilled Coke to an earthquake.

"Somebody needs to address this solution," said Giusto. "Consumers want to know that it's being backed up and want to forget about it."

But don't expect the situation to improve anytime soon. "I don't think there's a silver bullet that happens in the next year or two," said Mike McGuire, an analyst who covers digital media for Gartner.
___

© 2008, San Jose Mercury News (San Jose, Calif.).
Visit MercuryNews.com, the World Wide Web site of the Mercury News, at http://www.mercurynews.com.
Distributed by McClatchy-Tribune Information Services.

» Next Article in Technology - Other: Toting a laptop? Relief's in store at airport checkpoints

would you recommend this story?

 

User Rating

3.3 out of 5 after 23 total votes
  • not at all
  • 1
  • 2
  • 3
  • 4
  • 5
  • highly

Leave a Comment or

Rank filter

Move the slider to adjust rank threshold, so that you can hide some of the comments.
Posted by fuchikoma 09/03/08 14:40
Rank: 5/5 after 2 votes
Very true. I am a technical support analyst, but don't let the title fool you, I've been using PCs for about 22 years. I've lost files to crashes because as a kid I just couldn't afford backups. I've lost 15 year old files!

Now I back up certain files to an external hard drive, but all of my "media" (non-program) files are mirrored - my PC has a pair of disks that hold the same data in what's known as "RAID 1." It's a cheap conumer level solution that may not be usable if my PC itself died, but it's SOMETHING, and mechanical parts are most likely to fail.

Ideally... I could encrypt an external disk with something like TrueCrypt, using a nice speedy algorithm, then back up everything to it (or them?) regularly, and store them in a post office box to keep them off-site in case of natural disasters or... I don't know... freakish unheard of electromagnetic discharges?

But fundamentally:
- Use media with a long shelf life. Not CDR/DVD-Rs, they use photochemicals and some may lose data in 3-5 years. Seriously. It's hit me too.

- Backup regularly. "It's ok, I have a copy of that file from 2003!" ...no.

- Off-site storage. If at all possible... and if you have anything you don't want the world to know, encrypt it. Doing so is free, and only a tiny nuisance these days.
Posted by starannihilator 09/03/08 17:59
Not rated yet.
All good advice. I'm in the storage industry, and for my personal stuff, I backup with ... they say..
Cost Effective Online Data Backup http://www.amerivaultez.com
plug />

It is cheap, easy but robust if you wanna get into it, automatic... umm it's online backup. Dunno what else to say. Lots of settings, as well as backend reporting for admins.

I really did my homework and this is basically MozyPro (or whatever the best one is) resold by a company known for support and recovery / DR. I look at it as getting personal service instead of automatically generated FAQs and stuff. Though you can get those too, lol

They have a server version too, if you are going to use it for work (or whatever).
Posted by mike352 09/03/08 21:58
Rank: 5/5 after 2 votes
I don't see the point of this article - it just complains about the state of things - it doesn't suggest any course of action or what might be on the horizon. It doesn't even suggest making the average consumer more aware of the necessity of backing up their data - all it says is that "backing up data is still too complex a task for most consumers".
Posted by Oderfla 09/03/08 23:31
Not rated yet.
@mike Fortunately we have a fairly concientious group perusing these articles and two out of four so far have suggested alternatives.
Posted by DoctorKnowledge 09/04/08 00:22
Not rated yet.
This data problem is very real. At NASA one day, I wandered into a room full of reel-to-reel tapes a guy was working on. He said it was the complete (and only!) record of one of the moon landers. Sometimes, he said, when he put a tape on the machine, it just turned into confetti. He was trying to save what little was left.

Also, one option not mentioned above: If it's really important, print it to cotton paper, using a B&W laserjet (not an inkjet). I have many things I otherwise would have lost due to problems with storage media. Put it on cotton paper, and stick it in a bank vault, and your g-g-g-g-g grandchildren will be able to read it with zero problem.
Posted by Jarek 09/04/08 04:22
Not rated yet.
There are possible data correction methods, which are resistant to error density fluctuations.
They rather have to (?) need a lot of computation to cope with hard cases, but it's not large price if we want to recover archive.
I'm describing one approach here:
http://www.scienc...?t=34353
Posted by Noumenon 09/04/08 06:25
Not rated yet.
See, this is why cavemen carved there stuff in stone and didn't waste time on technology,... ironically they didn't have anything important to record.

Seriously though, the key is redundancy like a Raid HDD setup even if done manually, (cloned backup to multiple drives.). The article didn't mention this obvious solution (?).

Those who don't do regular backups in 2008, probably don't have valuable data anyway, and many who do are warehousing reruns of Lavern & Shirly.
Posted by Mayday 09/04/08 10:58
Not rated yet.
I disagree with the article's primary point that the barrier is complexity. The act of backing up, either to disc or an external drive is not complex. It is pretty much drag-and-drop. The real barrier seems to be cost, both in time and money.

Memory has remained very expensive on a user file-unit basis. True, actual megabyte cost has fallen, but the user file unit size (digital images, music files, videos, etc) is outpacing the actual megabyte price slide.

For example, I'm going from a 7mp camera that records jpgs to a 13.5mp camera that records RAW. That's going from 2.5mb per photo to over 35mb(approx). So I'm falling well behind in the cost-to-backup battle.

It's a neccessary cost that I'll absorb. But I do wish that someone would hurry up and do the math: Getting the cost of memory down(I mean WAY down) will dramatically increase the across-the-board market penetration of all things digital.

Cheap cheap memory in the pathway to a true digital revolution.
Posted by lowbatteries 09/05/08 00:29
Not rated yet.
No mention in the whole article about "cloud" storage, like Amazon's S3, or high-capacity Blu-ray, or even extremely fault tolerant RAID drive setups, ZFS pools, all this becoming much more available to the average user. Skip the article and just read the comments - they're more useful.
Posted by CreepyD 09/08/08 07:48
Not rated yet.
As far as photo's go, it's not all about the megapixels. Buy a cheap 5MP camera and an expensive 5MP camera, and the pics will be very different. 3MP is way big enough for A4 printing on a decent camera. 13MP is silly unless you want huge posters.