Geekzone: technology news, blogs, forums
Guest
Welcome Guest.
You haven't logged in yet. If you don't have an account you can register now.


Filter this topic showing only the reply marked as answer View this topic in a long page with up to 500 replies per page Create new topic
1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16
1852 posts

Uber Geek
+1 received by user: 513


  Reply # 1852570 25-Aug-2017 13:55
Send private message quote this post

SirHumphreyAppleby:

 

I am using Bigpipe and CrashPlan Australia. I didn't experience the slowdown you've indicated. I backed up >10TB at the sustained rate.

 

I should mention my CrashPlan configuration has been tweaked somewhat. I am using backup sets, with data broken up in to (now) 6-7TB logical cunks to prioritise backups and hopefully reduce memory requirements. I also have increased the memory available to Java, and disabled both deduplication and compression.

 

Currently sitting at around 40Mbs^-1.

 

 

Thanks @SirHumphreyAppleby.

 

I'm BigPipe and CrashPlan Australia too.

 

I've got mine in a couple of logical chunks, but I haven't disabled dedup or compression though or done anything with Java.

 

With Java, what did you set it to. My default values I think are max 4GB if I am reading this right?

 

uintx ErgoHeapSizeLimit = 0
uintx HeapSizePerGCThread = 87241520
uintx InitialHeapSize := 268435456
uintx LargePageHeapSizeThreshold = 134217728
uintx MaxHeapSize := 4280287232

 

 


352 posts

Ultimate Geek
+1 received by user: 110


  Reply # 1852580 25-Aug-2017 14:07
Send private message quote this post

Paul1977:

 

 

 

I've got mine in a couple of logical chunks, but I haven't disabled dedup or compression though or done anything with Java.

 

With Java, what did you set it to. My default values I think are max 4GB if I am reading this right?

 

uintx MaxHeapSize := 4280287232

 

 

Mine is also set to 4GB (You can check in CrashPlan using the 'java mx' command).

 

It seems that deduplication was reset to "Automatic" at some point. I have now manually adjusted these back to "Minimal" (sorry, not "Off"). You can however turn compression off completely.

 

My speeds have got quite a bit slower since this morning. Currently at just over 30Mbs^-1. That's still an order of magnitude higher than what you were seeing, and almost 100% faster than on my 200/20 connection. Hopefully overnight speeds are similar to what I was seeing this morning. If it gets down to anything close to 3Mbs^-1, CrashPlan will be abandoned. I can't afford to spend a year backing up my files.


 
 
 
 


BDFL - Memuneh
59075 posts

Uber Geek
+1 received by user: 10347

Administrator
Trusted
Geekzone
Subscriber

  Reply # 1852584 25-Aug-2017 14:10
Send private message quote this post

I have removed four machines from Crashplan now. Will remove another three by end of weekend.




1444 posts

Uber Geek
+1 received by user: 124

Trusted

  Reply # 1852586 25-Aug-2017 14:14
Send private message quote this post

So I assume the peer to peer function is dying also?





CPU: Intel 3770k| RAM: F3-2400C10D-16GTX G.Skill Trident X |MB:  Gigabyte Z77X-UD5H-WB | GFX: GV-N660OC-2GD gv-n660oc-2gd GeForce GTX 660 | Monitor: Qnix 27" 2560x1440

 

Want to be with an awesome ISP? Want $20 credit too? Use this link to sign up to BigPipe.


1852 posts

Uber Geek
+1 received by user: 513


  Reply # 1852592 25-Aug-2017 14:23
Send private message quote this post

SirHumphreyAppleby:

 

Mine is also set to 4GB (You can check in CrashPlan using the 'java mx' command).

 

It seems that deduplication was reset to "Automatic" at some point. I have now manually adjusted these back to "Minimal" (sorry, not "Off"). You can however turn compression off completely.

 

My speeds have got quite a bit slower since this morning. Currently at just over 30Mbs^-1. That's still an order of magnitude higher than what you were seeing, and almost 100% faster than on my 200/20 connection. Hopefully overnight speeds are similar to what I was seeing this morning. If it gets down to anything close to 3Mbs^-1, CrashPlan will be abandoned. I can't afford to spend a year backing up my files.

 

 

I misunderstood, I thought you meant the settings in Java itself (e.g. max heap size etc) rather than the settings in CrashPlan. Looks like I must have tweaked this initially already and forgotten about it, because mine is actually set to 5GB when I checked with the java mx option. In practice it seems to use about 1.5GB.

 

I'll turn off compression and change dedupe down to minimal and test it.

 

Thanks for the help.


703 posts

Ultimate Geek
+1 received by user: 420


  Reply # 1852781 25-Aug-2017 18:56
Send private message quote this post

mentalinc:

So I assume the peer to peer function is dying also?



Yes. Also most annoying.




"War is an ugly thing, but not the ugliest of things. The decayed and degraded state of moral and patriotic feeling which thinks that nothing is worth war is much worse. The person who has nothing for which he is willing to fight, nothing which is more important than his own personal safety, is a miserable creature and has no chance of being free unless made and kept so by the exertions of better men than himself."
- John Stuart Mill


1051 posts

Uber Geek
+1 received by user: 68

Subscriber

  Reply # 1852800 25-Aug-2017 19:45
Send private message quote this post

Started using CloudBerryLab and Google Cloud nearline storage. Using the CloudBerryLab Server trial at the moment, but my backups always fail anywhere between 10-80% with the following message in history:

 

"The underlying connection was closed: Could not establish trust relationship for the SSL/TLS secure channel"

 

followed by

 

"The operation was cancelled".

 

I was expecting a 'set and forget' type approach to setting this up. Anyone else had issues setting this up?

 

Think I might ask CloudBerryLab..

 

 

 

Backup is from 2x network shares, hosted on FreeNAS.

 

Backup size is about 200GB.

 

Windows Server 2008R2 (licenced).


13256 posts

Uber Geek
+1 received by user: 2220

Trusted
Subscriber

  Reply # 1852815 25-Aug-2017 20:28
Send private message quote this post

jjnz1:

Started using CloudBerryLab and Google Cloud nearline storage. Using the CloudBerryLab Server trial at the moment, but my backups always fail anywhere between 10-80% with the following message in history:


"The underlying connection was closed: Could not establish trust relationship for the SSL/TLS secure channel"


followed by


"The operation was cancelled".


I was expecting a 'set and forget' type approach to setting this up. Anyone else had issues setting this up?


Think I might ask CloudBerryLab..


 


Backup is from 2x network shares, hosted on FreeNAS.


Backup size is about 200GB.


Windows Server 2008R2 (licenced).



Try Backblaze B2 trial, just to see what happens. 10GB free.




AWS Certified Solution Architect Professional, Sysop Administrator Associate, and Developer Associate
TOGAF certified enterprise architect
Professional photographer


318 posts

Ultimate Geek
+1 received by user: 12


  Reply # 1852854 26-Aug-2017 01:32
Send private message quote this post

Stu:

 

Whilst it does suck, this has been in the rumour mill for some months. I guess they're entitled to do what they want with their business, and it's not like they haven't given plenty of notice. I don't have a huge amount backed up, and while Crashplan offering the switch to their business plan at a discount is nice, it would seem Backblaze might be the better option and is not a bad price?

 

 

I wouldn't say slightly over 2 month is plenty of notice. It's not as bad as it could have been but not plenty. And yes that's all I got as my subscription was due to expire soon so I only have the 2 months extra plus a little more. Sure I could move to Crashplan for Business at the discounted price temporarily provided none of my devices (I was on the family plan) had more than 5TB which helps although depending on the number of devices will still cost more than the family plan even given the Australian price for the family plan. IMO it would have been better if Crashplan had offered everyone the option to extend for at least 6 months at their own cost from the old price. Better still if they let you extend until the end of the family plan. The way they handled this means how long you have depends a lot on where you were in your subscription. Some people have the opposite problem since they just renewed but have decided they want to move sooner rather than later but Crashplan isn't offering refunds.


1051 posts

Uber Geek
+1 received by user: 68

Subscriber

  Reply # 1852870 26-Aug-2017 08:28
Send private message quote this post

timmmay:

Try Backblaze B2 trial, just to see what happens. 10GB free.

 

 

 

Wow, setting up was miles easier than Google Cloud Storage. I did it in less than 2 minutes. GCS was around 30-40 minutes of pissing around.

 

Backup is running now... at 13Mbps.

 

At bit different to 180Mbps for GCS.

 

Any tips to make it faster? Thread count is at 50. I have 500Mbps upload connection.

 

 

 

After the first 5GB, it started running at 170Mbps. Now its back to 20Mbps.

 

 

 

So far it seems very easy. I like the reporting and notifications for exceeding daily free allowances (class B and downloads etc).


13256 posts

Uber Geek
+1 received by user: 2220

Trusted
Subscriber

  Reply # 1852896 26-Aug-2017 09:31
Send private message quote this post

jjnz1:

 

 

 

Wow, setting up was miles easier than Google Cloud Storage. I did it in less than 2 minutes. GCS was around 30-40 minutes of pissing around.

 

Backup is running now... at 13Mbps.

 

At bit different to 180Mbps for GCS.

 

Any tips to make it faster? Thread count is at 50. I have 500Mbps upload connection.

 

 

 

After the first 5GB, it started running at 170Mbps. Now its back to 20Mbps.

 

 

B2 is nice and easy.

 

Try increasing the number of threads CloudBerry is using.  Tools -> Options -> Advanced -> Thread Count





AWS Certified Solution Architect Professional, Sysop Administrator Associate, and Developer Associate
TOGAF certified enterprise architect
Professional photographer


BDFL - Memuneh
59075 posts

Uber Geek
+1 received by user: 10347

Administrator
Trusted
Geekzone
Subscriber

  Reply # 1852921 26-Aug-2017 11:45
Send private message quote this post

Just remember a high numbers of threads can easily saturate your connection - even on a fast fibre - because of TCP and because of CPU contention. I think 50 is a bit much unless you have a high end Core i7...





13256 posts

Uber Geek
+1 received by user: 2220

Trusted
Subscriber

  Reply # 1852924 26-Aug-2017 12:05
Send private message quote this post

I didn't notice you said 50. Mine's set at 3 threads and I max out my 20Mbps upload to S3 on the US West Coast. 50 could be limited by hard drive performance, lots of seeking.





AWS Certified Solution Architect Professional, Sysop Administrator Associate, and Developer Associate
TOGAF certified enterprise architect
Professional photographer


BDFL - Memuneh
59075 posts

Uber Geek
+1 received by user: 10347

Administrator
Trusted
Geekzone
Subscriber

  Reply # 1853095 26-Aug-2017 21:05
Send private message quote this post

Not happy that Cloudberry is taking a VSS backup but loses its shadow copy...

 

And no email with errors. Crashplan never failed there...

 





13256 posts

Uber Geek
+1 received by user: 2220

Trusted
Subscriber

  Reply # 1853096 26-Aug-2017 21:18
Send private message quote this post

Email support, they probably won't reply until next week but they'll want to know and will likely fix it.





AWS Certified Solution Architect Professional, Sysop Administrator Associate, and Developer Associate
TOGAF certified enterprise architect
Professional photographer


1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16
Filter this topic showing only the reply marked as answer View this topic in a long page with up to 500 replies per page Create new topic



Twitter »

Follow us to receive Twitter updates when new discussions are posted in our forums:



Follow us to receive Twitter updates when news items and blogs are posted in our frontpage:



Follow us to receive Twitter updates when tech item prices are listed in our price comparison site:





News »

Talking net neutrality on RNZ Nine-to-Noon
Posted 24-Nov-2017 12:11


Air New Zealand experiments with blockchain technology
Posted 23-Nov-2017 15:39


Symantec selects Amazon Web Services to deliver cloud security
Posted 23-Nov-2017 10:40


New Zealand Ministry of Education chooses Unisys for cloud-based education resourcing management system
Posted 22-Nov-2017 22:00


Business analytics software powers profits for NZ wine producers
Posted 22-Nov-2017 21:52


Pyrios strikes up alliance with Microsoft integrator UC Logiq
Posted 22-Nov-2017 21:51


The New Zealand IT services ecosystem - it's all digital down here
Posted 22-Nov-2017 21:49


Volvo to supply tens of thousands of autonomous drive compatible cars to Uber
Posted 22-Nov-2017 21:46


From small to medium and beyond: Navigating the ERP battlefield
Posted 21-Nov-2017 21:12


Business owners: ERP software selection starts (and finishes) with you
Posted 21-Nov-2017 21:11


Why I'm not an early adopter
Posted 21-Nov-2017 10:39


Netatmo launches smart home products in New Zealand
Posted 20-Nov-2017 20:06


Huawei Mate 10: Punchy, long battery life, artificial intelligence
Posted 20-Nov-2017 16:30


Propel launch Disney Star Wars Laser Battle Drones
Posted 19-Nov-2017 21:26


UFB killer app: Speed
Posted 17-Nov-2017 17:01



Geekzone Live »

Try automatic live updates from Geekzone directly in your browser, without refreshing the page, with Geekzone Live now.



Are you subscribed to our RSS feed? You can download the latest headlines and summaries from our stories directly to your computer or smartphone by using a feed reader.

Alternatively, you can receive a daily email with Geekzone updates.