Geekzone: technology news, blogs, forums
Guest
Welcome Guest.
You haven't logged in yet. If you don't have an account you can register now.


salmonthief

3 posts

Wannabe Geek


#197885 16-Jun-2016 15:31
Send private message

Hi all,

 

This is less of a photo related problem than a data related problem but I imagine at least some of you have come across this issue and maybe even resolved it!

 

I use google photo for all my photo backups - perfect now that most of my photo taking comes from cameras- the auto backup tool for mobile really makes for a seamless experience in my books (IMHO, YMMV etc. etc.).

 

The issue comes with my legacy data - about 100gb of DSLR and other digital photos that I've got backed up on multiple HDs around the place. I really want to bring everything together in one place but, NZ being Nz, uploading 100gb of data is tough. I've tried just setting the google photos upload tool to the HD and leaving it to upload over multiple days, but after the odd interruption (the mac 'unmounting' the HD randomly) and 20 odd days trying, I've only uploaded something like 5gb of the data overall.

 

So I've looked into physical uploads (Iron Mountain in the US is an example of this - send them an HD and they'll upload to your account, for a fee .. something like $200 + for the data plus postage of HD both ways). Does anyone know of:

 

- Local alternatives to Iron mountain (I'd imagine anyone with a fibre upload connection could do this fairly easily??)

 

- Anyone who has used Iron mountain

 

- Any other alternatives.

 

I'm not 100% tied to using google photos for my could backup (basically just want something not physically in my house) but I would really like to have everything in one place.

 

Oh, and going forward, I'm pretty sure 100% of our photos/video will come from our phones. Not trying to troll the photo forum, just the classic 'the best camera you have is the camera you have with you all the time!'.


Create new topic
jonb
1796 posts

Uber Geek
+1 received by user: 545

Trusted

  #1575092 16-Jun-2016 15:34
Send private message

Probably easiest is to find a friend with an unlimited UFB connection and leave your laptop at their place for a day or two.




salmonthief

3 posts

Wannabe Geek


#1575113 16-Jun-2016 15:42
Send private message

Was thinking that. Anyone live in East Auckland with an UFB and wants to be my friend?

 

Alternatively, I could wait until October when we get UFB (if you believe the signs Chorus have put up, that is) laughing


timmmay
20858 posts

Uber Geek
+1 received by user: 5350

Trusted
Lifetime subscriber

  #1575121 16-Jun-2016 15:55
Send private message

Use Amazon Glacier, along with a tool that supports resumed uploads. Any of the free Amazon clients should do that. Or even better upload to Amazon S3 then have it archive to Glacier, because of the way Glacier works with vaults this may be easier.




davidcole
6099 posts

Uber Geek
+1 received by user: 1465

Trusted

  #1575130 16-Jun-2016 16:07
Send private message

In you backup do you have changing files?  I did most of my 100gb backup when I was on ADSL....it just took a long time.  I'd take a few folders at a time and let it go (I use crashplan, and also had it going to another local machine) - ie two copies.

 

Then you just keep adding to it.

 

 





Previously known as psycik

Home Assistant: Gigabyte AMD A8 Brix, Home Assistant with Aeotech ZWave Controller, Raspberry PI, Wemos D1 Mini, Zwave, Shelly Humidity and Temperature sensors
Media:Chromecast v2, ATV4 4k, ATV4, HDHomeRun Dual
Server
Host Plex Server 3x3TB, 4x4TB using MergerFS, Samsung 850 evo 512 GB SSD, Proxmox Server with 1xW10, 2xUbuntu 22.04 LTS, Backblaze Backups, usenetprime.com fastmail.com Sharesies Trakt.TV Sharesight 


hio77
'That VDSL Cat'
13036 posts

Uber Geek
+1 received by user: 3896

ID Verified
Trusted
Lizard Networks
Subscriber

  #1575131 16-Jun-2016 16:10
Send private message

davidcole:

 

In you backup do you have changing files?  I did most of my 100gb backup when I was on ADSL....it just took a long time.  I'd take a few folders at a time and let it go (I use crashplan, and also had it going to another local machine) - ie two copies.

 

Then you just keep adding to it.

 

 

 

 

 

 

This is how i did mine too for crashplan, rate limited upstream, deduplication, compression. was actually faster than expected.





#include <std_disclaimer>

 

Any comments made are personal opinion and do not reflect directly on the position my current or past employers may have. 


wellygary
8810 posts

Uber Geek
+1 received by user: 5287


  #1575132 16-Jun-2016 16:12
Send private message

davidcole: I'd take a few folders at a time and let it go  

 

+1, chunk it down into managable sized folder,

 

Even on ADSL, with 1mb/s upstream you should be able to do 5GB in ~12 hours, -which is a good overnight transfer job..


 
 
 

Want to support Geekzone and browse the site without the ads? Subscribe to Geekzone now (monthly, annual and lifetime options).
josephhinvest
1550 posts

Uber Geek
+1 received by user: 322

ID Verified
Trusted

  #1575135 16-Jun-2016 16:17
Send private message

It took us about four months to upload our photos to iCloud!

mentalinc
3384 posts

Uber Geek
+1 received by user: 1023

Trusted

  #1575169 16-Jun-2016 17:01
Send private message

timmmay:

 

Use Amazon Glacier, along with a tool that supports resumed uploads. Any of the free Amazon clients should do that. Or even better upload to Amazon S3 then have it archive to Glacier, because of the way Glacier works with vaults this may be easier.

 

 

 

 

Be careful with Glacier

 

https://medium.com/@karppinen/how-i-ended-up-paying-150-for-a-single-60gb-download-from-amazon-glacier-6cb77b288c3e#.ynf6owpnm





CPU: AMD 5900x | RAM: GSKILL Trident Z Neo RGB F4-3600C16D-32GTZNC-32-GB | MB:  Asus X570-E | GFX: EVGA FTW3 Ultra RTX 3080Ti| Monitor: LG 27GL850-B 2560x1440

 

Quic: https://account.quic.nz/refer/473833 R473833EQKIBX 


shk292
2916 posts

Uber Geek
+1 received by user: 2040

Lifetime subscriber

  #1575173 16-Jun-2016 17:08
Send private message

I use Amazon Cloud drive, which (if you appear to be in the US) offers unlimited photo backups for around $12 per year.  There is a desktop app which you use for uploading, and as others have said, adding the photos in manageable size folders helps


timmmay
20858 posts

Uber Geek
+1 received by user: 5350

Trusted
Lifetime subscriber

  #1575184 16-Jun-2016 17:18
Send private message

mentalinc:

 

Be careful with Glacier

 

https://medium.com/@karppinen/how-i-ended-up-paying-150-for-a-single-60gb-download-from-amazon-glacier-6cb77b288c3e#.ynf6owpnm

 

 

Yeah glacier is an archiving service, not a transaction file store. Hard lesson to learn!


salmonthief

3 posts

Wannabe Geek


  #1575252 16-Jun-2016 19:15
Send private message

Cheers for the reply all, glad to know others have been through the pain - 4 months is some serious commitment Joseph!

 

Yeah, I was quite happy to leave it for a month going but the fact that its stopped twice is an issue. Mostly due to the fact that I don't know down to the file what has uploaded and what hasn't. So when I go to upload again, I inevitably end up with duplicates. I'm not so keen to go folder by folder (500 and something folders) but maybe that's the only option!

 

At this stage, probably wait for fibre and try again then. Rather not be sorting through gigabytes of photos looking for duplicates....


 
 
 

Shop now on AliExpress (affiliate link).
josephhinvest
1550 posts

Uber Geek
+1 received by user: 322

ID Verified
Trusted

  #1575345 16-Jun-2016 21:07
Send private message

It was a considerable PITA to be honest. On ADSL with 8M down and 1M up, the photos upload would saturate the upload bandwidth and nothing else in the house would work (many many devices). So we had to keep pausing and unpausing the photos.

DeepBlueSky
549 posts

Ultimate Geek
+1 received by user: 67


  #1576082 18-Jun-2016 08:24
Send private message

Hi,
First time post on this forum page, Google offer a desktop app for bulk uploads to Google Photo's here is the link https://photos.google.com/apps . I just noticed I missed that you had already tried the app.

Oh and one word of caution that you most likely already know, I'm guessing your using the paid version of Google Photo's as you mention these photos are from a DSLR the files will remain unchanged, if you use the free unlimited service Google apply compression but from what I have read it's not too bad. Here is Google blurb https://support.google.com/photos/answer/6220791?hl=en.

Create new topic








Geekzone Live »

Try automatic live updates from Geekzone directly in your browser, without refreshing the page, with Geekzone Live now.



Are you subscribed to our RSS feed? You can download the latest headlines and summaries from our stories directly to your computer or smartphone by using a feed reader.