Geekzone: technology news, blogs, forums
Guest
Welcome Guest.
You haven't logged in yet. If you don't have an account you can register now.
Filter this topic showing only the reply marked as answer View this topic in a long page with up to 500 replies per page Create new topic
1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | 17 | 18 | 19
2145 posts

Uber Geek
+1 received by user: 616


  Reply # 1852570 25-Aug-2017 13:55
Send private message quote this post

SirHumphreyAppleby:

 

I am using Bigpipe and CrashPlan Australia. I didn't experience the slowdown you've indicated. I backed up >10TB at the sustained rate.

 

I should mention my CrashPlan configuration has been tweaked somewhat. I am using backup sets, with data broken up in to (now) 6-7TB logical cunks to prioritise backups and hopefully reduce memory requirements. I also have increased the memory available to Java, and disabled both deduplication and compression.

 

Currently sitting at around 40Mbs^-1.

 

 

Thanks @SirHumphreyAppleby.

 

I'm BigPipe and CrashPlan Australia too.

 

I've got mine in a couple of logical chunks, but I haven't disabled dedup or compression though or done anything with Java.

 

With Java, what did you set it to. My default values I think are max 4GB if I am reading this right?

 

uintx ErgoHeapSizeLimit = 0
uintx HeapSizePerGCThread = 87241520
uintx InitialHeapSize := 268435456
uintx LargePageHeapSizeThreshold = 134217728
uintx MaxHeapSize := 4280287232

 

 


392 posts

Ultimate Geek
+1 received by user: 130


  Reply # 1852580 25-Aug-2017 14:07
Send private message quote this post

Paul1977:

 

 

 

I've got mine in a couple of logical chunks, but I haven't disabled dedup or compression though or done anything with Java.

 

With Java, what did you set it to. My default values I think are max 4GB if I am reading this right?

 

uintx MaxHeapSize := 4280287232

 

 

Mine is also set to 4GB (You can check in CrashPlan using the 'java mx' command).

 

It seems that deduplication was reset to "Automatic" at some point. I have now manually adjusted these back to "Minimal" (sorry, not "Off"). You can however turn compression off completely.

 

My speeds have got quite a bit slower since this morning. Currently at just over 30Mbs^-1. That's still an order of magnitude higher than what you were seeing, and almost 100% faster than on my 200/20 connection. Hopefully overnight speeds are similar to what I was seeing this morning. If it gets down to anything close to 3Mbs^-1, CrashPlan will be abandoned. I can't afford to spend a year backing up my files.


BDFL - Memuneh
60565 posts

Uber Geek
+1 received by user: 11503

Administrator
Trusted
Geekzone
Lifetime subscriber

1521 posts

Uber Geek
+1 received by user: 143

Trusted

  Reply # 1852586 25-Aug-2017 14:14
Send private message quote this post

So I assume the peer to peer function is dying also?





CPU: Intel 3770k| RAM: F3-2400C10D-16GTX G.Skill Trident X |MB:  Gigabyte Z77X-UD5H-WB | GFX: GV-N660OC-2GD gv-n660oc-2gd GeForce GTX 660 | Monitor: Qnix 27" 2560x1440

 

 


2145 posts

Uber Geek
+1 received by user: 616


  Reply # 1852592 25-Aug-2017 14:23
Send private message quote this post

SirHumphreyAppleby:

 

Mine is also set to 4GB (You can check in CrashPlan using the 'java mx' command).

 

It seems that deduplication was reset to "Automatic" at some point. I have now manually adjusted these back to "Minimal" (sorry, not "Off"). You can however turn compression off completely.

 

My speeds have got quite a bit slower since this morning. Currently at just over 30Mbs^-1. That's still an order of magnitude higher than what you were seeing, and almost 100% faster than on my 200/20 connection. Hopefully overnight speeds are similar to what I was seeing this morning. If it gets down to anything close to 3Mbs^-1, CrashPlan will be abandoned. I can't afford to spend a year backing up my files.

 

 

I misunderstood, I thought you meant the settings in Java itself (e.g. max heap size etc) rather than the settings in CrashPlan. Looks like I must have tweaked this initially already and forgotten about it, because mine is actually set to 5GB when I checked with the java mx option. In practice it seems to use about 1.5GB.

 

I'll turn off compression and change dedupe down to minimal and test it.

 

Thanks for the help.


1019 posts

Uber Geek
+1 received by user: 572
Inactive user


  Reply # 1852781 25-Aug-2017 18:56
Send private message quote this post

mentalinc:

So I assume the peer to peer function is dying also?



Yes. Also most annoying.

1085 posts

Uber Geek
+1 received by user: 84

Subscriber

  Reply # 1852800 25-Aug-2017 19:45
Send private message quote this post

Started using CloudBerryLab and Google Cloud nearline storage. Using the CloudBerryLab Server trial at the moment, but my backups always fail anywhere between 10-80% with the following message in history:

 

"The underlying connection was closed: Could not establish trust relationship for the SSL/TLS secure channel"

 

followed by

 

"The operation was cancelled".

 

I was expecting a 'set and forget' type approach to setting this up. Anyone else had issues setting this up?

 

Think I might ask CloudBerryLab..

 

 

 

Backup is from 2x network shares, hosted on FreeNAS.

 

Backup size is about 200GB.

 

Windows Server 2008R2 (licenced).


13908 posts

Uber Geek
+1 received by user: 2468

Trusted
Subscriber

  Reply # 1852815 25-Aug-2017 20:28
Send private message quote this post

jjnz1:

Started using CloudBerryLab and Google Cloud nearline storage. Using the CloudBerryLab Server trial at the moment, but my backups always fail anywhere between 10-80% with the following message in history:


"The underlying connection was closed: Could not establish trust relationship for the SSL/TLS secure channel"


followed by


"The operation was cancelled".


I was expecting a 'set and forget' type approach to setting this up. Anyone else had issues setting this up?


Think I might ask CloudBerryLab..


 


Backup is from 2x network shares, hosted on FreeNAS.


Backup size is about 200GB.


Windows Server 2008R2 (licenced).



Try Backblaze B2 trial, just to see what happens. 10GB free.




AWS Certified Solution Architect Professional, Sysop Administrator Associate, and Developer Associate
TOGAF certified enterprise architect
Professional photographer


339 posts

Ultimate Geek
+1 received by user: 14


  Reply # 1852854 26-Aug-2017 01:32
Send private message quote this post

Stu:

 

Whilst it does suck, this has been in the rumour mill for some months. I guess they're entitled to do what they want with their business, and it's not like they haven't given plenty of notice. I don't have a huge amount backed up, and while Crashplan offering the switch to their business plan at a discount is nice, it would seem Backblaze might be the better option and is not a bad price?

 

 

I wouldn't say slightly over 2 month is plenty of notice. It's not as bad as it could have been but not plenty. And yes that's all I got as my subscription was due to expire soon so I only have the 2 months extra plus a little more. Sure I could move to Crashplan for Business at the discounted price temporarily provided none of my devices (I was on the family plan) had more than 5TB which helps although depending on the number of devices will still cost more than the family plan even given the Australian price for the family plan. IMO it would have been better if Crashplan had offered everyone the option to extend for at least 6 months at their own cost from the old price. Better still if they let you extend until the end of the family plan. The way they handled this means how long you have depends a lot on where you were in your subscription. Some people have the opposite problem since they just renewed but have decided they want to move sooner rather than later but Crashplan isn't offering refunds.


1085 posts

Uber Geek
+1 received by user: 84

Subscriber

  Reply # 1852870 26-Aug-2017 08:28
Send private message quote this post

timmmay:

Try Backblaze B2 trial, just to see what happens. 10GB free.

 

 

 

Wow, setting up was miles easier than Google Cloud Storage. I did it in less than 2 minutes. GCS was around 30-40 minutes of pissing around.

 

Backup is running now... at 13Mbps.

 

At bit different to 180Mbps for GCS.

 

Any tips to make it faster? Thread count is at 50. I have 500Mbps upload connection.

 

 

 

After the first 5GB, it started running at 170Mbps. Now its back to 20Mbps.

 

 

 

So far it seems very easy. I like the reporting and notifications for exceeding daily free allowances (class B and downloads etc).


13908 posts

Uber Geek
+1 received by user: 2468

Trusted
Subscriber

  Reply # 1852896 26-Aug-2017 09:31
Send private message quote this post

jjnz1:

 

 

 

Wow, setting up was miles easier than Google Cloud Storage. I did it in less than 2 minutes. GCS was around 30-40 minutes of pissing around.

 

Backup is running now... at 13Mbps.

 

At bit different to 180Mbps for GCS.

 

Any tips to make it faster? Thread count is at 50. I have 500Mbps upload connection.

 

 

 

After the first 5GB, it started running at 170Mbps. Now its back to 20Mbps.

 

 

B2 is nice and easy.

 

Try increasing the number of threads CloudBerry is using.  Tools -> Options -> Advanced -> Thread Count





AWS Certified Solution Architect Professional, Sysop Administrator Associate, and Developer Associate
TOGAF certified enterprise architect
Professional photographer


BDFL - Memuneh
60565 posts

Uber Geek
+1 received by user: 11503

Administrator
Trusted
Geekzone
Lifetime subscriber

  Reply # 1852921 26-Aug-2017 11:45
Send private message quote this post

Just remember a high numbers of threads can easily saturate your connection - even on a fast fibre - because of TCP and because of CPU contention. I think 50 is a bit much unless you have a high end Core i7...





13908 posts

Uber Geek
+1 received by user: 2468

Trusted
Subscriber

  Reply # 1852924 26-Aug-2017 12:05
Send private message quote this post

I didn't notice you said 50. Mine's set at 3 threads and I max out my 20Mbps upload to S3 on the US West Coast. 50 could be limited by hard drive performance, lots of seeking.





AWS Certified Solution Architect Professional, Sysop Administrator Associate, and Developer Associate
TOGAF certified enterprise architect
Professional photographer


BDFL - Memuneh
60565 posts

Uber Geek
+1 received by user: 11503

Administrator
Trusted
Geekzone
Lifetime subscriber

  Reply # 1853095 26-Aug-2017 21:05
Send private message quote this post

Not happy that Cloudberry is taking a VSS backup but loses its shadow copy...

 

And no email with errors. Crashplan never failed there...

 





13908 posts

Uber Geek
+1 received by user: 2468

Trusted
Subscriber

  Reply # 1853096 26-Aug-2017 21:18
Send private message quote this post

Email support, they probably won't reply until next week but they'll want to know and will likely fix it.





AWS Certified Solution Architect Professional, Sysop Administrator Associate, and Developer Associate
TOGAF certified enterprise architect
Professional photographer


1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 | 12 | 13 | 14 | 15 | 16 | 17 | 18 | 19
Filter this topic showing only the reply marked as answer View this topic in a long page with up to 500 replies per page Create new topic

Twitter »

Follow us to receive Twitter updates when new discussions are posted in our forums:



Follow us to receive Twitter updates when news items and blogs are posted in our frontpage:



Follow us to receive Twitter updates when tech item prices are listed in our price comparison site:





News »

N4L helping TAKA Trust bridge the digital divide for Lower Hutt students
Posted 18-Jun-2018 13:08


Winners Announced for 2018 CIO Awards
Posted 18-Jun-2018 13:03


Logitech Rally sets new standard for USB-connected video conference cameras
Posted 18-Jun-2018 09:27


Russell Stanners steps down as Vodafone NZ CEO
Posted 12-Jun-2018 09:13


Intergen recognised as 2018 Microsoft Country Partner of the Year for New Zealand
Posted 12-Jun-2018 08:00


Finalists Announced For Microsoft NZ Partner Awards
Posted 6-Jun-2018 15:12


Vocus Group and Vodafone announce joint venture to accelerate fibre innovation
Posted 5-Jun-2018 10:52


Kogan.com to launch Kogan Mobile in New Zealand
Posted 4-Jun-2018 14:34


Enable doubles fibre broadband speeds for its most popular wholesale service in Christchurch
Posted 2-Jun-2018 20:07


All or Nothing: New Zealand All Blacks arrives on Amazon Prime Video
Posted 2-Jun-2018 16:21


Innovation Grant, High Tech Awards and new USA office for Kiwi tech company SwipedOn
Posted 1-Jun-2018 20:54


Commerce Commission warns Apple for misleading consumers about their rights
Posted 30-May-2018 13:15


IBM leads Call for Code to use cloud, data, AI, blockchain for natural disaster relief
Posted 25-May-2018 14:12


New FUJIFILM X-T100 aims to do better job than smartphones
Posted 24-May-2018 20:17


Stuff takes 100% ownership of Stuff Fibre
Posted 24-May-2018 19:41



Geekzone Live »

Try automatic live updates from Geekzone directly in your browser, without refreshing the page, with Geekzone Live now.



Are you subscribed to our RSS feed? You can download the latest headlines and summaries from our stories directly to your computer or smartphone by using a feed reader.

Alternatively, you can receive a daily email with Geekzone updates.