Geekzone: technology news, blogs, forums
Guest
Welcome Guest.
You haven't logged in yet. If you don't have an account you can register now.




116 posts

Master Geek
+1 received by user: 7


Topic # 223533 4-Oct-2017 19:12
Send private message quote this post

As a member of the NZ flight simulation community, I'm looking to organise some way of distributing freeware scenery for use in desktop simulators. There are existing worldwide file libraries, but they just don't allow for the sort of file size which I'm hoping to be able to handle -- the AVSIM.com library, for instance limits uploads to 500MB, but I'm looking at multiple files 1 -- 5GB. Through my own business I develop and distribute 'payware' scenery for New Zealand, served via AWS/Cloudfront, and while I'm very happy to continue doing that for my own online store, there are plenty of local developers who would produce freeware if there was a free, easy way to get it to users.

 

A typical release might be of interest to 500 -- 1000 users in the short term, and up to 3000 -- 5000 longterm. Not too sure of the current local interest, there's been a real shakeup in the sim community lately, with our one remaining online community on its last legs... About half my user-base is overseas, so I'd imagine that any freeware would have a similar percentage. Top scenario would be serving 1TB over the first 2 months per release, maybe a couple of new releases per month.

 

What about torrents? Can someone give me an idiot's intro to this, although I try to do everything myself on my own online store, I'm not that technically competent in anything except flight sim scenery:)

 

Another option is to build a site which relies on sponsorship/advertising (similar to geekzone!), so what are the cheap options to host this sort of data?


Create new topic
13156 posts

Uber Geek
+1 received by user: 2191

Trusted
Subscriber

  Reply # 1877447 4-Oct-2017 19:59
Send private message quote this post

Digital Ocean object storage. US$5/month for 250GB storage and 1TB downloads. The same thing on AWS S3 would be a fairly stunning $93 /month at 1GB/month, though S3 does torrents which could reduce your bandwidth. BackBlaze B2 is cheaper than S3 but much more than DO OS.





AWS Certified Solution Architect Professional, Sysop Administrator Associate, and Developer Associate
TOGAF certified enterprise architect
Professional photographer


1164 posts

Uber Geek
+1 received by user: 237


  Reply # 1877690 5-Oct-2017 10:18
One person supports this post
Send private message quote this post

https://mega.nz/

 

50Gb free
Downloads are fast (compared to some other free file share services)
And its not riddled with ads & malware popups .

 

if you need more than 50Gb, either buy an a/c or use mulitple free a/c's

 

yes, its kim.com , but its still a good service .

 

torrenting would be a pick of last resort (just my opinion) , and that requires others to allow sharing via their PC.
Torrents store & download  from other peoples PC's (sort of)
You'll find users would download via torrent, then disable the torrent service, so the whole thing would grind to a crawl.

 

For files over 1Gb, consider spitting them into two or more smaller files (using zip, RAR etc) .

 

 


 
 
 
 


1382 posts

Uber Geek
+1 received by user: 151


  Reply # 1877830 5-Oct-2017 12:54
Send private message quote this post
561 posts

Ultimate Geek
+1 received by user: 29


  Reply # 1877937 5-Oct-2017 15:29
Send private message quote this post

Surely a Torrent tracker would be a good option? Share the bandwidth and hosting responsibilities across the community.

2274 posts

Uber Geek
+1 received by user: 650

Trusted
Subscriber

  Reply # 1878043 5-Oct-2017 18:47
Send private message quote this post

I really like the idea of using torrents to share the distribution load, but I think less than 20% of your users would download via this method.

 

I used to download Linux distributions using torrents whenever possible (thinking was being nice and reducing the load on the distro organisations's servers), but these days I simply can't be bothered.  It's easy to click to start the download, minimise it, and walk away.





"4 wheels move the body.  2 wheels move the soul."

“Don't believe anything you read on the net. Except this. Well, including this, I suppose.” Douglas Adams



116 posts

Master Geek
+1 received by user: 7


  Reply # 1878122 5-Oct-2017 20:48
Send private message quote this post

Thanks for the suggestions, much appreciated!

 

Giving some thought to torrents, I do think that a lot of our users would find it new territory, From my experience with my paying customers, although some have picked up a lot of technical skills from years of simming, most just like something simple. Plenty of 'older generation' folks, I'm pretty much an average age for a simmer, at 61:) Plus there's the general public perception of torrents, I know that they have a lot of uses, but there is a perception that they equate to piracy etc.

 

I did look at Koordinates when I got the email from them last month, promoting their data hosting service, and although it would be something I'd look at for my business, for this particular purpose it is a bit expensive. Still, I'd love to see a nice simple interface where a user can draw a rectangle over a block of photoscenery tiles to download them....

 

I've used mega before, receiving single file transfers, and I have no problem with Dotcom! This might be worth a serious look, as each developer could have their own account, but even then for some it would be a learning experience to package it up -- I've been thinking that maybe I could handle all that for them, in which case something like Digital Ocean might be better. I wonder what sort of download speed people could expect here in NZ? That's a bit of a problem with the major flightsim libraries, most are far enough away and/or throttled enough so that a big download can take hours/days.

 

I would imagine that this is something I would set up myself, and give developers access to allow uploads, and I'd be happy to pay a small monthly cost... I make flightsim scenery for a living, but it's always a struggle in a tiny corner of a niche market.

 

Regarding limiting file size, I already do this on my own site, I restrict single downloads to 1.4GB. However times change, and with the new simulators coming onto the market this will need to change at some stage -- I'm talking photo scenery here, which is more and more becoming the 'standard'. New Zealand is lucky to have the LINZ service, supplying quality data for free, so at some stage I'm sure we'll see the whole country in photo scenery, for a number of different simulators -- the MS-based sims, such as FSX on Steam, Lockheed Martin Prepar3d, plus the others -- X-plane and Aerofly FS2, which only uses photo scenery. Data-wise, it's a growth industry, although the user base isn't what it was 10 years ago.


3084 posts

Uber Geek
+1 received by user: 509

Trusted

  Reply # 1878147 5-Oct-2017 21:47
2 people support this post
Send private message quote this post

Look for a torrent based sync application. Not a standard torrent client. 

 

Its pretty simple - you just share a directory on your computer for 'read only' access, and it gives you a magnet link. 

 

Everyone else just installs the same program, inserts the magnet link and then points it at their game templates directory. In your game forum you can make a sticky post that shows others how to do this with screenshots. 

 

When you save a file into the shared directory, the other users will automatically begin downloading it. 

 

When one user has downloaded some (or all) of the pieces that make up a file in the directory, they begin sharing it to other connected users. 

 

When a user connects, their computer scans the local directory, and will download any missing files from other users. 

 

When you have your computer shut down, other users still online will continue to share the files. 

 

 

 

It may interest you to know that many games from major studios have a background torrent application built in which transparently downloads updates and patches, and shares them with others while you play the game - this lowers the burden on the studio to provide bandwidth for serving up the content. 





Ray Taylor
Taylor Broadband (rural hawkes bay)
www.ruralkiwi.com

There is no place like localhost
For my general guide to extending your wireless network Click Here




185 posts

Master Geek
+1 received by user: 30


  Reply # 1878173 5-Oct-2017 21:58
Send private message quote this post

what about something like github

 

https://github.com/pricing




116 posts

Master Geek
+1 received by user: 7


  Reply # 1878717 6-Oct-2017 22:12
Send private message quote this post

raytaylor:

 

Look for a torrent based sync application. Not a standard torrent client. 

 

 

 

 

From a bit of a look at what's available, that would be a great fit -- and really it is the sort of thing which would be easy enough to trial. Initially I would think that we'd be distributing installers, as it's a bit of a process getting everything in the proper location, and activated in the simulator, but I can see a time when we could just drop new scenery straight into the simulator.

 

I wonder what would represent a healthy number of seeders, given that our users are probably not early adopters of high speed internet...

 

Thanks!


641 posts

Ultimate Geek
+1 received by user: 51


  Reply # 1878735 7-Oct-2017 00:16
Send private message quote this post

I’m guessing you can’t dont have fibre available to you? If so you could get an unlimited plan with a high upload speed say 100mb and setup a pc to serve the files? A lot of isps now offer plans with 500mb upload speeds for reasonable prices



116 posts

Master Geek
+1 received by user: 7


  Reply # 1878886 7-Oct-2017 11:11
Send private message quote this post

Well, fibre is available here, but really I'm looking for something which doesn't rely too much on me long-term. A month ago when I shifted here I chose not to go for fibre, simply because the wait was too long, plus it's a shared driveway, and with the cabinet outside my house I get good VDSL speeds... Upload speed is a major consideration for me, simply because at some stages of development I'm uploading huge quantities of data, but after shifting from 1MB on ADSL last month my 27Mb upload speed seems great:)


689 posts

Ultimate Geek
+1 received by user: 146


  Reply # 1879428 8-Oct-2017 15:26
Send private message quote this post

usenet?


197 posts

Master Geek
+1 received by user: 2

Subscriber

  Reply # 1879889 9-Oct-2017 13:43
Send private message quote this post

Amazon S3 supports torrent delivery, you could make that the only allowed delivery method and that'd keep costs to a minimum?

Create new topic



Twitter »

Follow us to receive Twitter updates when new discussions are posted in our forums:



Follow us to receive Twitter updates when news items and blogs are posted in our frontpage:



Follow us to receive Twitter updates when tech item prices are listed in our price comparison site:





News »

Vodafone TV — television in the cloud
Posted 17-Oct-2017 19:29


Nokia 8 review: Classy midrange pure Android phone
Posted 16-Oct-2017 07:27


Why carriers might want to embrace Commerce Commission study, MVNOs
Posted 13-Oct-2017 09:42


Fitbit launches Ionic, its health and fitness smartwatch
Posted 12-Oct-2017 15:52


Xero launches machine learning automation to improve coding accuracy for small businesses
Posted 12-Oct-2017 15:45


Bank of New Zealand uses Intel AI to detect financial crime
Posted 12-Oct-2017 15:39


Sony launches Xperia XZ1, a smartphone with real-time 3D capture
Posted 11-Oct-2017 10:26


Notes on Nokia’s phone comeback
Posted 10-Oct-2017 10:06


Air New Zealand begins Inflight Wi-Fi rollout
Posted 9-Oct-2017 20:16


The latest mobile phones in perspective
Posted 9-Oct-2017 18:34


Review: Acronis True Image 2018 — serious backup
Posted 8-Oct-2017 11:22


Lenovo launches ThinkPad Anniversary Edition 25
Posted 7-Oct-2017 23:16


Less fone, more tech as Vodafone gets brand make-over
Posted 6-Oct-2017 08:16


API Talent Achieves AWS MSP Partner Status
Posted 5-Oct-2017 21:20


Stellar Consulting Group now a Domo Partner
Posted 5-Oct-2017 21:03



Geekzone Live »

Try automatic live updates from Geekzone directly in your browser, without refreshing the page, with Geekzone Live now.



Are you subscribed to our RSS feed? You can download the latest headlines and summaries from our stories directly to your computer or smartphone by using a feed reader.

Alternatively, you can receive a daily email with Geekzone updates.