Geekzone: technology news, blogs, forums
Guest
Welcome Guest.
You haven't logged in yet. If you don't have an account you can register now.


Filter this topic showing only the reply marked as answer View this topic in a long page with up to 500 replies per page Create new topic
1 | ... | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16
316 posts

Ultimate Geek
+1 received by user: 12


  Reply # 1855031 30-Aug-2017 00:35
Send private message quote this post

SirHumphreyAppleby:

 

There may be some additional resources used in order to flag blocks encrypted with Blowfish vs AES, but there must already be headers for blocks as encryption and compression can be disabled on archives. Seems improbable they wouldn't have a free bit somewhere in the headers in order to flag Blowfish/AES. The limit therefore appears to be entirely arbitrary.

 

I believe the technical platform constraint is that they are hoping people with larger backups go elsewhere. Last year they changed the definition of commercially reasonable for the multi-computer Home plan from 20TB to 5TB. I note the CrashPlan for Small Business terms now state e.g. 5TB, while the Home terms said i.e. 5TB (previously 20TB). That's quite a significant change in definition. Sneaky.

 

 

They didn't say it had anything to do with the Blowfish/AES issue. I imagine much more likely it has to do with however the storage works on their end on either or both sides. Maybe something like if you have more than 5TB, it's in multiple parts at some level. I'm sure they could have found a solution if they tried hard enough and probably the fact they'd prefer people with such large backups to go elsewhere is a factor, but I wouldn't be surprised if there really is a techical reason for it.


1849 posts

Uber Geek
+1 received by user: 513


  Reply # 1855191 30-Aug-2017 11:20
Send private message quote this post

RmACK:

 

Good luck! I had a deep pruning forced on me right when I wanted to do a restore - and it took over 24 hours! 

 

I can't emphasise enough just how big a speed increase I got by turning dedupe & compression to minimum settings - I frequently get over 120Mbps, but it does vary down to 20Mbps sometimes. Before changing settings, I never went over 8Mbps. This is on Bigpipe 1000/500 fibre. And for large backup sets, assign 1GB per TB to Java or risk random crashes.

 

 

All finished now and migration complete.

 

The pruning seemed to just randomly stop and restart again on it's own several times, but if it seemed like it wasn't going to restart on it's own (or I just got impatient) I restarted the CrashPlan service which would then enable the "Compact" button again for me to manually tell it to restart. It always seemed to pickup where it left off, and I suspect if I was a little more patient it would have completed on its own without my interference (probably would have been safer to just leave it as well rather than restarting services in the middle of it, but it seems to have worked out OK in my instance).

 

I've now turned off compression and set dedupe to minimum, and while I have only backed up a little bit since the migration the speed does seem much improved.

 

I have Java set at 5GB for my 4.9TB backup set, but memory usage seems to sit at "only" 1.8GB most of the time.

 

 


 
 
 
 


1849 posts

Uber Geek
+1 received by user: 513


  Reply # 1855195 30-Aug-2017 11:25
Send private message quote this post

Nil Einne:

 

They didn't say it had anything to do with the Blowfish/AES issue. I imagine much more likely it has to do with however the storage works on their end on either or both sides. Maybe something like if you have more than 5TB, it's in multiple parts at some level. I'm sure they could have found a solution if they tried hard enough and probably the fact they'd prefer people with such large backups to go elsewhere is a factor, but I wouldn't be surprised if there really is a techical reason for it.

 

 

I have no idea about the technicalities of it however the migration is essentially instantaneous, so it doesn't seem like the are actually "migrating" the data itself from one system to another. It really just seems like the data is staying exactly where it is.


563 posts

Ultimate Geek
+1 received by user: 5


  Reply # 1855196 30-Aug-2017 11:28
Send private message quote this post

Do you have to change clients when you move to the Pro plan? Or does the existing client continue?





Working for Service Plus - www.serviceplus.co.nz

Authorised Service Agent for Apple, BenQ, Navman, Sony, and Toshiba - warranty & non-warranty repairs.

1849 posts

Uber Geek
+1 received by user: 513


  Reply # 1855199 30-Aug-2017 11:30
One person supports this post
Send private message quote this post

jpwise:

 

Do you have to change clients when you move to the Pro plan? Or does the existing client continue?

 

 

It automatically updates the client for you the next time you launch it.


160 posts

Master Geek
+1 received by user: 18


  Reply # 1855201 30-Aug-2017 11:32
Send private message quote this post

Paul1977:
I've now turned off compression and set dedupe to minimum, and while I have only backed up a little bit since the migration the speed does seem much improved.

I have Java set at 5GB for my 4.9TB backup set, but memory usage seems to sit at "only" 1.8GB most of the time.


The 1GB/TB is only a rule of thumb I saw suggested by CP support. The key is that you allowed more than what is needed. I know from experience that hitting the limit causes it to crash. The default 1GB is clearly too little for your backup set. I think IIRC the RAM usage varies with dedupe settings and what data it is backing up at the time so YMMV.

1849 posts

Uber Geek
+1 received by user: 513


  Reply # 1855202 30-Aug-2017 11:38
Send private message quote this post

RmACK: The 1GB/TB is only a rule of thumb I saw suggested by CP support. The key is that you allowed more than what is needed. I know from experience that hitting the limit causes it to crash. The default 1GB is clearly too little for your backup set. I think IIRC the RAM usage varies with dedupe settings and what data it is backing up at the time so YMMV.

 

Yeah, I'm going to leave it at 5GB as there is no benefit in lowering it since it only uses what it needs anyway.

 

I'd obviously read the same support article as you you when I originally set it up as 5GB.


352 posts

Ultimate Geek
+1 received by user: 110


  Reply # 1855229 30-Aug-2017 12:21
Send private message quote this post

Paul1977:

 

jpwise:

 

Do you have to change clients when you move to the Pro plan? Or does the existing client continue?

 

 

It automatically updates the client for you the next time you launch it.

 

 

Upgrades are fully automatic. If you have remote systems, they will updated without any user interaction, which is nice. The client is essentially (if not exactly) the same, just rebranded for CrashPlan Pro.

 

There is a CrashPlan native client, which I thought Pro was using... turns out that's something different again. CrashPlan have been promising a native client for CrashPlan Home for more than two years, and still nothing. Hopefully we will _finally_ see it, and the excessive waste of memory and annoying Java configuration will be a thing of the past.


13245 posts

Uber Geek
+1 received by user: 2216

Trusted
Subscriber

  Reply # 1855231 30-Aug-2017 12:22
Send private message quote this post

Memory usage is for deduplication block hashes. A native client might be able to use memory a little more efficiently, and could be a touch faster, but I doubt it will be night and day. Java is pretty well optimised these days.





AWS Certified Solution Architect Professional, Sysop Administrator Associate, and Developer Associate
TOGAF certified enterprise architect
Professional photographer


178 posts

Master Geek
+1 received by user: 63


  Reply # 1855408 30-Aug-2017 17:06
Send private message quote this post

Hi, so here's my story.

 

 

 

I renewed my crashplan home annual subscription about a month ago.

 

I've now upgraded to crashplan pro (I had 5.4TB of backups online and the migration didn't delete any of it).

 

So, the next 11months are covered by my annual subscription renewal, then the next 12 months will be $2.50/month, then I'll worry about what to do then.

 

 

 

I backup 1 server, and I have 5 workstations using veeam endpoint protection, which backup to the server. Then crashplan uploads that (I have the do not backup open files option ticked, and that seems to avoid issues).

 

 

 

I am using myrepublic Gigabit UFB.

 

Backups typically 120Mb/s

 

Restores typically 300Mb/s

 

 

 

 


22 posts

Geek
+1 received by user: 6


  Reply # 1855412 30-Aug-2017 17:21
One person supports this post
Send private message quote this post

I was a Crashplan customer. For the past 18 months or so I've used Arq to backup both to a local hard drive and to Amazon Web Services. The storage is very very cheap. In addition I've found the 50GB free from Mega to be useful to backup and sync one particular set of data between two machines.

 

It has all run very well.

 

 

 

 

 

 


352 posts

Ultimate Geek
+1 received by user: 110


  Reply # 1855418 30-Aug-2017 17:29
Send private message quote this post

UncleArthur:

 

 

 

I backup 1 server, and I have 5 workstations using veeam endpoint protection, which backup to the server. Then crashplan uploads that (I have the do not backup open files option ticked, and that seems to avoid issues).

 

 

I'd be very cautious using such an approach as CrashPlan doesn't upload a snapshot of files, and it's unlikely the archive software would keep files open until the backup was complete (assuming you consider that good software design, and trust file locking over the network, which I don't). If CrashPlan is backing up while you are updating your backups from client to server, you could end up with corrupt archives. At a minimum, I'd set CrashPlan to only scan for files once a day, at a time you're not going to be updating the backups.


178 posts

Master Geek
+1 received by user: 63


  Reply # 1855556 30-Aug-2017 23:20
One person supports this post
Send private message quote this post

SirHumphreyAppleby:

 

 

 

.... At a minimum, I'd set CrashPlan to only scan for files once a day, at a time you're not going to be updating the backups.

 

 

 

 

Thanks, that is what I have.

 

Of note I have had no issues with several restore scenarios, including a complete raid array failure and recovering everything from crashplan (which took about 2 days to restore 5.4 TB btw.)

 

I've also recovered veeam backups from crashplan without issue.


34 posts

Geek
+1 received by user: 1


  Reply # 1855871 31-Aug-2017 11:53
Send private message quote this post

UncleArthur:

 

 I've now upgraded to crashplan pro  

 

 

Hmm, that's a point - is there any reason NOT to upgrade to Pro now rather than later?

 

Or to put it another way, is there any reason to stay with Home while it still exists (apart from computer to computer backups which I don't use).

 

 

 

UncleArthur:

 

So, the next 11months

 

 

Actually I think you have 13 months - they've extended existing subs by 60 days.


178 posts

Master Geek
+1 received by user: 63


  Reply # 1856052 31-Aug-2017 17:09
Send private message quote this post

mgeek:

 

 

 

Actually I think you have 13 months - they've extended existing subs by 60 days.

 

 

 

 

Good point.


1 | ... | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16
Filter this topic showing only the reply marked as answer View this topic in a long page with up to 500 replies per page Create new topic



Twitter »

Follow us to receive Twitter updates when new discussions are posted in our forums:



Follow us to receive Twitter updates when news items and blogs are posted in our frontpage:



Follow us to receive Twitter updates when tech item prices are listed in our price comparison site:





News »

Netatmo launches smart home products in New Zealand
Posted 20-Nov-2017 20:06


Huawei Mate 10: Punchy, long battery life, artificial intelligence
Posted 20-Nov-2017 16:30


Propel launch Disney Star Wars Laser Battle Drones
Posted 19-Nov-2017 21:26


UFB killer app: Speed
Posted 17-Nov-2017 17:01


The case for RSS — MacSparky
Posted 13-Nov-2017 14:35


WordPress and Indieweb: Take control of your online presence — 6:30 GridAKL Nov 30
Posted 11-Nov-2017 13:43


Chorus reveals technology upgrade for schools, students
Posted 10-Nov-2017 10:28


Vodafone says Internet of Things (IoT) crucial for digital transformation
Posted 10-Nov-2017 10:06


Police and Facebook launch AMBER Alerts system in NZ
Posted 9-Nov-2017 10:49


Amazon debuts Fire TV Stick Basic Edition in over 100 new countries
Posted 8-Nov-2017 05:34


Vodafone VoIP transition to start this month
Posted 7-Nov-2017 12:33


Spark enhances IoT network capability
Posted 7-Nov-2017 11:33


Vocus NZ sale and broadband competition
Posted 6-Nov-2017 14:36


Hawaiki reaches key milestone in landmark deep-sea fibre project
Posted 4-Nov-2017 13:53


Countdown launches new proximity online shopping app
Posted 4-Nov-2017 13:50



Geekzone Live »

Try automatic live updates from Geekzone directly in your browser, without refreshing the page, with Geekzone Live now.



Are you subscribed to our RSS feed? You can download the latest headlines and summaries from our stories directly to your computer or smartphone by using a feed reader.

Alternatively, you can receive a daily email with Geekzone updates.