Click here to Skip to main content
15,900,725 members

Welcome to the Lounge

   

For discussing anything related to a software developer's life but is not for programming questions. Got a programming question?

The Lounge is rated Safe For Work. If you're about to post something inappropriate for a shared office environment, then don't post it. No ads, no abuse, and no programming questions. Trolling, (political, climate, religious or whatever) will result in your account being removed.

 
GeneralRe: Food Question Pin
PIEBALDconsult3-Dec-16 12:59
mvePIEBALDconsult3-Dec-16 12:59 
GeneralRe: Food Question Pin
Nagy Vilmos3-Dec-16 21:28
professionalNagy Vilmos3-Dec-16 21:28 
GeneralRe: Food Question Pin
CPallini3-Dec-16 21:34
mveCPallini3-Dec-16 21:34 
GeneralRe: Food Question Pin
Vander Wunderbar4-Dec-16 9:50
Vander Wunderbar4-Dec-16 9:50 
GeneralRe: Food Question Pin
Mark_Wallace4-Dec-16 22:07
Mark_Wallace4-Dec-16 22:07 
GeneralRe: Food Question Pin
W Balboos, GHB5-Dec-16 1:09
W Balboos, GHB5-Dec-16 1:09 
GeneralRe: Food Question Pin
Chris Quinn5-Dec-16 3:11
Chris Quinn5-Dec-16 3:11 
QuestionFound the chink in my backup strategy's armor - the hard way Pin
dandy723-Dec-16 4:23
dandy723-Dec-16 4:23 
This will probably be long. But I'm gonna try to keep it brief nonetheless.

I have a system I essentially use as little more than a NAS, providing other systems on my LAN access to files via a share. Whenever I buy hard drives (eg, I've outgrown the storage capacity of what I currently have), I buy new drives in sets of 3:

a) One in the "live" system, powered on 24/7
b) One in an external USB3 enclosure, kept offline and physically disconnected unless I'm actively doing a backup and
c) One in a second external USB3 enclosure, that I keep off-site and swap with drive (b) above every month.

I'm a big believer in keeping things simple, so I just use robocopy in a batch file to sync changed files from the live disk to the backup drive. I only back up data files (nothing from the OS itself or executable files from running programs), so attempts to copy files while they may be in use and all that sort of crap is no concern. This has worked great for me for years.

A little while ago I found out I have a file that somehow got itself corrupted. The file is physically "ok", in the sense that it can be read and copied without any sort of file system error--it's the software that last wrote to it that managed to write bad data somehow and made it unusable--the content can no longer be parsed, and in fact the size went from a few hundred MBs down to a few dozen KBs. Clearly, something's gone horribly, horribly wrong and this file is simply no longer usable. There's nothing in it to recover--no need to even try.

Here's the real problem: I rather rarely need to use the file (which doesn't negate its importance), so the corruption happened a few months ago. During that time, I had plenty of time to back up that corrupt file over the last backup set, as well as the one from the disk I keep off-site. It's only when I happened to need the file that I realized the file was corrupt...along with the last two backups. D'Oh! | :doh:

People always say you need to backup, but also verify everything can be restored. That's great and all, as it proves the content can be read back when you need it and the file system integrity has not been compromised. That does nothing, however, for the integrity of the content of a file. No backup/verify strategy can help address this - the bits in the file from the backup match the source and it can be read back. That's not the problem that "backup but verify" addresses.

My backup drives aren't large enough to keep complete copies of multiple backup sets "just in case" I need to go back to an older version. And I'm not going to keep buying additional hard drives every few months just so I have a few "snapshots in time". Again, how far back do I need to go?

What's the best strategy here? I guess what I really need is versioning applied in some fashion (and volume shadow copies kinda exist for that purpose), but because MS has still so far put so little effort into integrating this in the OS so it's actually usable, trying to use that goes against my attempts to keep my backup mechanism simple. I've had someone suggest running Git locally (ha!), but where do I draw the line as to what files to include? Essentially I'd want to include the entire drive--what would be the point of keeping multiple versions of only a subset of them?

So again...what's a good, simple, and cost-effective way to address this?
AnswerRe: Found the chink in my backup strategy's armor - the hard way Pin
Ron Anders3-Dec-16 4:45
Ron Anders3-Dec-16 4:45 
GeneralRe: Found the chink in my backup strategy's armor - the hard way Pin
dandy723-Dec-16 6:30
dandy723-Dec-16 6:30 
GeneralRe: Found the chink in my backup strategy's armor - the hard way Pin
TheGreatAndPowerfulOz3-Dec-16 6:35
TheGreatAndPowerfulOz3-Dec-16 6:35 
GeneralRe: Found the chink in my backup strategy's armor - the hard way Pin
dandy723-Dec-16 7:37
dandy723-Dec-16 7:37 
GeneralRe: Found the chink in my backup strategy's armor - the hard way Pin
Ron Anders3-Dec-16 8:01
Ron Anders3-Dec-16 8:01 
GeneralRe: Found the chink in my backup strategy's armor - the hard way Pin
Ron Anders3-Dec-16 8:16
Ron Anders3-Dec-16 8:16 
GeneralRe: Found the chink in my backup strategy's armor - the hard way Pin
dandy723-Dec-16 16:06
dandy723-Dec-16 16:06 
AnswerRe: Found the chink in my backup strategy's armor - the hard way Pin
TheGreatAndPowerfulOz3-Dec-16 6:24
TheGreatAndPowerfulOz3-Dec-16 6:24 
AnswerRe: Found the chink in my backup strategy's armor - the hard way Pin
theoldfool3-Dec-16 14:24
professionaltheoldfool3-Dec-16 14:24 
AnswerRe: Found the chink in my backup strategy's armor - the hard way Pin
charlieg3-Dec-16 11:11
charlieg3-Dec-16 11:11 
GeneralRe: Found the chink in my backup strategy's armor - the hard way Pin
dandy723-Dec-16 16:02
dandy723-Dec-16 16:02 
GeneralRe: Found the chink in my backup strategy's armor - the hard way Pin
charlieg4-Dec-16 3:42
charlieg4-Dec-16 3:42 
GeneralRe: Found the chink in my backup strategy's armor - the hard way Pin
dandy724-Dec-16 6:33
dandy724-Dec-16 6:33 
GeneralRe: Found the chink in my backup strategy's armor - the hard way Pin
charlieg14-Dec-16 4:27
charlieg14-Dec-16 4:27 
GeneralDilemma of a modern day developer Pin
virang_212-Dec-16 18:53
virang_212-Dec-16 18:53 
GeneralRe: Dilemma of a modern day developer PinPopular
Ravi Bhavnani2-Dec-16 19:18
professionalRavi Bhavnani2-Dec-16 19:18 
GeneralRe: Dilemma of a modern day developer PinPopular
BillWoodruff2-Dec-16 20:07
professionalBillWoodruff2-Dec-16 20:07 

General General    News News    Suggestion Suggestion    Question Question    Bug Bug    Answer Answer    Joke Joke    Praise Praise    Rant Rant    Admin Admin   

Use Ctrl+Left/Right to switch messages, Ctrl+Up/Down to switch threads, Ctrl+Shift+Left/Right to switch pages.


Straw Poll

Were you affected by the geomagnetic storms this past weekend?
Communication disruptions, electrified pipes, random unexplained blue-screens in Windows - the list of effects is terrifying.
  Results   494 votes