Geekzone: technology news, blogs, forums
Guest
Welcome Guest.
You haven't logged in yet. If you don't have an account you can register now.




17 posts

Geek


# 208977 7-Mar-2017 13:41
Send private message

Hi All,

 

A few years ago I decided I was never going to have a (personal) data loss issue again, and purchased a NAS for my home.

 

I have upgraded it a couple of times over the years, and currently it has 10TB of storage on it.
(2x 4TB RAID 1, 2x 6TB RAID 1)

 

This has given me a certain piece of mind with regard to hardware failure; but as is not reiterated enough, redundancy is not backup.

 

This has been bugging me of late, especially because if I accidentally delete something on the NAS drives, or some other unforeseen manipulation of the data, my redundancy is not going to help me one bit.

 

This leads me to the following question: What's a decent backup solution in the age of such large disks.

 

I have looked into online backups; but being capped at 100GB a month, it would take 100 months of full cap usage to back up all my data.
The only other thing that comes to mind is using tape-backup.

 

I am OK with the data being on 'slow storage', and the tape solution appeals to me as AFAIK they are designed for 'long term data storage', so perhaps may suffer less from bit-rot than other solutions.

 

The price, though, is not very appealing; especially if I were trying to minimise tape usage with something like LTO6, the drives themselves costing 3k, not to mention the tapes.
These are usually geared at more server type environments too; requiring a SAS connection.

 

So IT pro's, what's a geek to do about backup in the age where it's totally realistic to have ten's of terabytes of personal storage ?

 

Is there some magical unicorn solution I am not aware of?


View this topic in a long page with up to 500 replies per page Create new topic
 1 | 2 | 3
14804 posts

Uber Geek
+1 received by user: 2007


  # 1732502 7-Mar-2017 13:45
Send private message

In terms of an actual backup, I just clone a drive once a week. So if I do delete a file, I can find it on the backup.


1675 posts

Uber Geek
+1 received by user: 916


  # 1732529 7-Mar-2017 14:12
One person supports this post
Send private message

Is it worth examining what the TB of data consists of and whether it needs to be backed up?  Eg if it's all downloaded movies (or "Linux ISOs" to use the polite phrase), or rips of CDs/DVDs/BDs, then it doesn't need to be backed up.

 

You could separate it into replaceable and non-replaceable, and only back up the latter


 
 
 
 




17 posts

Geek


  # 1732532 7-Mar-2017 14:16
Send private message

 

 

@shk292 -

 

Yep a valid point. A lot of it may not need to be backed up; but a lot of it is things like machine images, which are not so easily segregated.

 

But there's also the time that it is going to take me to sort through it all; which I plan to do, but during which time I am in a danger zone.
In fact what prompted this is that I am going to be a lot more active with the data - organising and tidying / deleting - during which period it is much more likely I could instigate a situation where I need a backup!

 

@mattwnz

 

Disks don't really seem like a viable long term backup medium to me.

I have had experiences where archived/stored disks fail to spin up after just sitting for a decent period.


2529 posts

Uber Geek
+1 received by user: 753

Trusted
Lifetime subscriber

  # 1732536 7-Mar-2017 14:29
One person supports this post
Send private message

I would encourage you having a quick trawl through your data and separating it into two or three tiers of importance.  The most important would be backed up daily by CrashPlan or similar, the mid-tier stuff being backed up by an occasional copy to a large external HDD (or two) that are kept off site, and the least valuable stuff being protected only by the mirror.  The least valuable stuff is probably just there because you have the space, but you would in reality never access it.

 

If (for example) you are a photographer and have lots of client images, charge them for the storage or give them their images on a 50Gb blu-ray disc (and keep a second copy yourself?) so long term storage is not your problem.





"4 wheels move the body.  2 wheels move the soul."

“Don't believe anything you read on the net. Except this. Well, including this, I suppose.” Douglas Adams

1815 posts

Uber Geek
+1 received by user: 525


  # 1732538 7-Mar-2017 14:31
One person supports this post
Send private message

mattwnz:

In terms of an actual backup, I just clone a drive once a week. So if I do delete a file, I can find it on the backup.

that's all fun and games till you realise you've backed up a bunch of corrupted or changed data

Imagine accidentally deleting half the pages of a book you've been writing and not knowing half the document is lost till a few weeks later.

4036 posts

Uber Geek
+1 received by user: 2781

Trusted

  # 1732541 7-Mar-2017 14:38
One person supports this post
Send private message

I have lots of stuff to backups, over a decade of sports photography all in RAW format (and jpgs, and other files) in total there is about 4TB of data I want backed up REALLY well.. .There's another 5-6TB I backup too, but not as strictly.

 

 

 

I have a cheap 4TB WD NAS drive with an external 5TB drive attached to that, giving me 9TB of network attached backup storage on a UPS. Everything is synced there daily.

 

I also have a fireproof safe with a waterproof clip-lock container where I store my local HDD backups that I refresh every month or 2.

 

Finally, I use backblaze.com which maintains a live backup of all my photos and everything else except movies and TV etc...

 

 

 

It's also worth mentioning that I rotate my spinning disks every so often - it used to be every 18 months but I am stretching that to just over 2 years at the moment. The larger good drives from my main PC go into the Safe backup pool, the local NAS drives and local PC drives get sold/given away and I put new drives in my PC and NAS.

 

 

 

There isn't an economical consumer level backup for lots of data (multiple TB) except for external HDDs. Get yourself an esata or USB3 cradle and a few big bare sata disks. If you're not going to run an online backup as well, maintain two offline backups and store one at home and one at another physical location.

 

 

 

Oh, I got my first computer in 1984 and I have never lost any data. I also use to work building (and testing) storage and backup systems for Sun machines for govt departments, universities and ISPs in the late 90's/early 2000s.

 

 

Cheers - N

 

 





--

 

Please note all comments are the product of my own brain and don't necessarily represent the position or opinions of my employer, previous employers, colleagues, friends or pets.




17 posts

Geek


  # 1732543 7-Mar-2017 14:40
Send private message

Hmm.

 

I wonder, renting a tape-drive seems like it could be an option for long time archival of the entire data-set.
Of course, recovery would require re-hiring, but that's probably acceptable.

 

 


1815 posts

Uber Geek
+1 received by user: 525


  # 1732592 7-Mar-2017 15:30
One person supports this post
Send private message

Upgrade your data plan for a month if you want to go the online route.

Has anyone used the cross-site mirror option provided by readynas units? Would be awesome if you had a family member also wanting such a setup, then theoretically you could mirror each other's backups offsite.

4378 posts

Uber Geek
+1 received by user: 669

Trusted

  # 1732598 7-Mar-2017 15:40
Send private message

Like others, split what it most important out, start with what's most important and give that to some online service.

 

I use crashplan, backing up from one server (any other machines copy their data to the server and that backs it up).  At the time I seeded my primary backup I was on ADSL (1mbps upload yo!!).  And it was a case of every couple of days or so, I'd add something else to the backup and let that tick over - while managing my usage (there was no unlimited then).

 

If you can bite the bullet and go unlimited for a month or so, and upload as much as possible.

 

I also had a secondary machine, and a bunch of in machine backups as cover while the cloud backup was running.





Previously known as psycik

OpenHAB: Gigabyte AMD A8 BrixOpenHAB with Aeotech ZWave Controller, Raspberry PI, Wemos D1 Mini, Zwave, Xiaomi Humidity and Temperature sensors and Bluetooth LE Sensors
Media:Chromecast v2, ATV4, Roku3, HDHomeRun Dual
Windows 10
Host (Plex Server/Crashplan): 2x2TB, 2x3TB, 1x4TB using DriveBender, Samsung 850 evo 512 GB SSD, Hyper-V Server with 1xW10, 1xW2k8, 2xUbuntu 16.04 LTS, Crashplan, NextPVR channel for Plex,NextPVR Metadata Agent and Scanner for Plex


3699 posts

Uber Geek
+1 received by user: 2166

Trusted
Lifetime subscriber

  # 1732614 7-Mar-2017 16:04
One person supports this post
Send private message

I use Crashplan





Information wants to be free. The Net interprets censorship as damage and routes around it.


1014 posts

Uber Geek
+1 received by user: 572
Inactive user


  # 1732629 7-Mar-2017 16:35
Send private message

Lias:

I use Crashplan



Me too. 10TB on there. It's great although there are some pitfalls.

If you go with the free Crashplan you can just use a local drive to backup or even use a friend's Crashplan code to back up to a drive you give them to set up on their computer. Do the initial backup by going aroundown there with your computer then it's just small amounts of changed data after that.

22049 posts

Uber Geek
+1 received by user: 4680

Trusted
Subscriber

  # 1732660 7-Mar-2017 17:42
Send private message

Crashplan seem to have built it to stop you using it for large data sets - will just sit synchronizing block information for days which the PC has to be left on for, then push a little bit up to the cloud, then start pruning things, then repeat the process only getting a few 100 gigs up a week at best.

 

Great on small sets where that carryon doesnt happen.





Richard rich.ms

1014 posts

Uber Geek
+1 received by user: 572
Inactive user


  # 1732675 7-Mar-2017 18:11
Send private message

richms:

 

Crashplan seem to have built it to stop you using it for large data sets - will just sit synchronizing block information for days which the PC has to be left on for, then push a little bit up to the cloud, then start pruning things, then repeat the process only getting a few 100 gigs up a week at best.

 

Great on small sets where that carryon doesnt happen.

 

 

I didn't have that issue. I did my initial backup in under 6 months on a 10Mbps VDSL connection, only because the international speed (Australia) was peaking at about 6Mbps. It did a bit of "Synchronising..." but it wasn't overly intrusive to the backup process.


65 posts

Master Geek
+1 received by user: 11


  # 1732737 7-Mar-2017 21:00
Send private message

I used to use Crashplan, but now use Arq. It's a standalone backup utility that can connect to a number of online backup locations - AWS, Google Drive, Dropbox, etc. Also does any local folder or NAS, as well as generic SFTP.

 

It's good to not be dependent on any online service that can adjust their prices as they want to, or possibly go bust. I used to use PictureLife for all by photo backups, but then they went bust and it was VERY HARD to get my photos off them. As everyone else also wanted to do the same. That doesn't scale.

 

So yeah - Arq is awesome. 


14741 posts

Uber Geek
+1 received by user: 2745

Trusted
Subscriber

  # 1732816 8-Mar-2017 06:59
Send private message

Incremental backups are essential IMHO. They protect you against corruption, viruses, etc. I use a couple of different programs and methods:

 

  • Cobian backup for my large images and videos. I have many TB of this, and I don't really want them smooshed into a few huge files. Cobian keeps the files intact, and if it changes it just makes another copy. It uses more disk, but I'm fine with that because files are rarely changed.
  • AOMEI backup. It's a fairly standard backup program, incremental and differential, everything stored in large files. I put all my smaller information in here.
  • Macrium reflect to back up my OS disk (which is why I prefer smaller SSDs or system partitions)
  • My backups are stored offsite. I also have a second offsite location that I update rarely, and another backup in the detached shed.
  • CrashPlan for online backups of what I consider most critical. This was mostly documents, not my commercial images (too large), but since we had a baby I also back up personal images into Crashplan.

 


 1 | 2 | 3
View this topic in a long page with up to 500 replies per page Create new topic



Twitter »

Follow us to receive Twitter updates when new discussions are posted in our forums:



Follow us to receive Twitter updates when news items and blogs are posted in our frontpage:



Follow us to receive Twitter updates when tech item prices are listed in our price comparison site:





News »

HPE to acquire supercomputing leader Cray
Posted 20-May-2019 11:07


Techweek starting around NZ today
Posted 20-May-2019 09:52


Porirua City Council first to adopt new council software solution Datascape
Posted 15-May-2019 12:00


New survey provides insight into schools' technology challenges and plans
Posted 15-May-2019 09:30


Apple Music now available on Alexa devices in Australia and New Zealand
Posted 15-May-2019 09:11


Make a stand against cyberbullying this Pink Shirt Day
Posted 14-May-2019 20:23


Samsung first TV manufacturer to launch the Apple TV App and Airplay 2
Posted 14-May-2019 20:11


Vodafone New Zealand sold
Posted 14-May-2019 07:25


Kordia boosts cloud performance with locally-hosted Microsoft Azure ExpressRoute
Posted 8-May-2019 10:25


Microsoft Azure ExpressRoute in New Zealand opens up faster, more secure internet for Kiwi businesses
Posted 8-May-2019 09:39


Vocus Communications to deliver Microsoft Azure Cloud Solutions through Azure ExpressRoute
Posted 8-May-2019 09:25


Independent NZ feature film #statusPending to premiere during WLG-X
Posted 6-May-2019 22:13


The ultimate dog photoshoot with Nokia 9 PureView #ForgottenDogsofInstagram
Posted 6-May-2019 09:41


Nokia 9 PureView available in New Zealand
Posted 6-May-2019 09:06


Motorola Solutions joins local partners to deliver advanced communications network in New Zealand
Posted 30-Apr-2019 21:50



Geekzone Live »

Try automatic live updates from Geekzone directly in your browser, without refreshing the page, with Geekzone Live now.


Support Geekzone »

Our community of supporters help make Geekzone possible. Click the button below to join them.

Support Geezone on PressPatron



Are you subscribed to our RSS feed? You can download the latest headlines and summaries from our stories directly to your computer or smartphone by using a feed reader.

Alternatively, you can receive a daily email with Geekzone updates.