Geekzone: technology news, blogs, forums
Welcome Guest.
You haven't logged in yet. If you don't have an account you can register now.

111 posts

Master Geek
+1 received by user: 22


Topic # 146769 28-May-2014 17:37
Send private message

Hi Geekzone,

I'm interested in knowing the technically-literate public's opinion on transparent content caching at the ISP.

Given that we're 150ms+ minimum away from a large portion of the Internet (via Southern Cross to America); are the improved page load times welcome? Is it evil? Does it break the end-to-end principle? Is that justified? Etc.

Disclaimer: This is to try and satisfy my own personal curiousity and doesn't indicate (or not indicate) my employer's intention to cache/not cache content.

“I do not think there is any thrill that can go through the human heart like that felt by the inventor as he sees some creation of the brain unfolding to success... Such emotions make a man forget food, sleep, friends, love, everything.” - Nikola Tesla


Disclaimer: Views expressed in my posts do not necessarily reflect those views of my employer.

View this topic in a long page with up to 500 replies per page Create new topic
 1 | 2
3343 posts

Uber Geek
+1 received by user: 1089


Reply # 1055275 28-May-2014 17:38
2 people support this post
Send private message

For.  It has benefits for users AND ISPs alike, and if done correctly, there's no real downside.

Gonna need popcorn for this thread, always a contentious issue :P

670 posts

Ultimate Geek
+1 received by user: 53

  Reply # 1055304 28-May-2014 17:55
Send private message

Im no expert when it comes to Transparent proxies, but the issues with the ex telstraclear/vodafone cable transparent proxy have been horrendous, seems to be settling down for now, maybe vodafone has a hold on what is going on, IMO so long as the Transparent Proxy is truly transparent no problems

796 posts

Ultimate Geek
+1 received by user: 262


  Reply # 1055312 28-May-2014 18:01
One person supports this post
Send private message

From a speed + resource usage perspective I think it's a good idea. Especially for large, static, popular content. However if/when it causes things to break or behave in unintended ways I'd much rather it wasn't being used at all.

26768 posts

Uber Geek
+1 received by user: 6247

Biddle Corp
Lifetime subscriber

  Reply # 1055325 28-May-2014 18:18
3 people support this post
Send private message

I think many people who trash proxies are the same people who use non ISP DNS servers - they don't understand how things work and are suspicious of people who may disagree with their view.

Clearly TelstraClear's cache has given many a bad impression and that has caused many issues, but there would be many who are oblivious to their ISP running a cache.

197 posts

Master Geek
+1 received by user: 2


  Reply # 1055327 28-May-2014 18:20
One person supports this post
Send private message

I think caching is one of those things that is a nice idea in principle, but for the issues it brings like caches going down or caching pages that shouldn't be cached I think they're just more of a nuisance.  In reality with the bulk of data use from major sites like YouTube/iTunes etc which all comes off CDN so caching doesn't really help much there.  I've never found myself dissatisfied with how fast a site loads from a far away destination without caching, with uncached throughput of 10-15Mbps from Europe now for web traffic that's entirely enough.  Different story for shifting huge amounts of data around but caching doesn't take care of that.

BDFL - Memuneh
61006 posts

Uber Geek
+1 received by user: 11843

Lifetime subscriber

  Reply # 1055331 28-May-2014 18:23
Send private message

I think transparent proxies/caches (whatever name you use) are a necessity here. Because of our distance to origin servers, because of costs and volume it makes sense.

As a Vodafone client (and using cable since the Chello days) I think they should manage it a little better and be more proactive when their gear suffers a stroke. If there are alarms they don't seem to be monitored seeing sometimes we have two or three days of bad performance until something happens. 

3602 posts

Uber Geek
+1 received by user: 2132

Spark NZ

  Reply # 1055334 28-May-2014 18:26
Send private message

Very strongly for... 

I must say the responses so far are refreshingly lucid.

Cheers - N

2511 posts

Uber Geek
+1 received by user: 935


  Reply # 1055402 28-May-2014 19:46
Send private message

Definitely think the benefits outweigh any potential downsides, especially given most implementations in NZ seem to be well-managed.

Windows 7 x64 // i5-3570K // 16GB DDR3-1600 // GTX660Ti 2GB // Samsung 830 120GB SSD // OCZ Agility4 120GB SSD // Samsung U28D590D @ 3840x2160 & Asus PB278Q @ 2560x1440
Samsung Galaxy S5 SM-G900I w/Spark

3241 posts

Uber Geek
+1 received by user: 1764

Lifetime subscriber

  Reply # 1055409 28-May-2014 19:53
2 people support this post
Send private message

I think overall it's a good thing, but only if ISP's offer customers an opt out option for their accounts.

It benefits the ISP's, it benefits the masses, but it does cause some issues and people should have the right to turn it off.

Information wants to be free. The Net interprets censorship as damage and routes around it.


Thinking about signing up to BigPipe? Get $20 credit with my referral link.

465 posts

Ultimate Geek
+1 received by user: 83

  Reply # 1055430 28-May-2014 20:14
Send private message

I understand the need for them and they probably work well in most cases, but had a bad experience with the Telecom proxy. I had to get them to disable it for our connection because it was either breaking sites or not refreshing content (not good when you're a web dev and you need to see the changes).

12683 posts

Uber Geek
+1 received by user: 5971


  Reply # 1055431 28-May-2014 20:20
One person supports this post
Send private message

No sleep lost about them.

Retired IT Manager. 
The views stated in my posts are my personal views and not that of any other organisation.


 It's our only home, lets clean it up then...


Take My Advice, Pull Down Your Pants And Slide On The Ice!



3534 posts

Uber Geek
+1 received by user: 1292


  Reply # 1055443 28-May-2014 20:37
One person supports this post
Send private message

With UFB roaring along the more local content the better!!

4025 posts

Uber Geek
+1 received by user: 1076


  Reply # 1055505 28-May-2014 21:55
2 people support this post
Send private message

Wish there were stats available on hit rates and bandwidth savings. The last figures i was shown for a several hundred person network running through bluecoats had low single digit savings, which seemed to be because of the huge amount of HTTPS traffic (they werent using their own certs to MITM)

Overall i think they are a good idea if done properly, as then it doesn't get in the way. I agree that many that dislike them just have a bitter taste in their mouth from poorly configured situations that they have been in, and then are worried they will be burned again everywhere else.

3215 posts

Uber Geek
+1 received by user: 620


  Reply # 1060589 6-Jun-2014 21:58
Send private message

We cache....and our customers love it.

I am constantly told that a subscribers rural 5mbit connection at their lifestyle section is faster than their urban 12mbit DSL connection - even when accessing local websites like trademe.

To achieve that opinion, we have two policies
1) Cache http and youtube - and keep customers within 20ms of the cache
2) Cache DNS and also keep customers within 20ms of the dns cache.

We have not yet looked into torrent caching as we dont have much torrent traffic on the network.

We use the appliansys cachebox system. There have been no problems whatsoever - and I would know as a person who has been using http caches and proxy servers since the days of Wingate, so I can recognise a caching problem before the average subscriber. But anyhow, the appliansys system we use is much better.

I have no idea what Telstra Clear or Slingshot were doing when they have their systems screw up.
 - Slingshot you may all remember was intercepting pages and serving them up to other users. Eg. one subscriber would log into trademe, and then if another subscriber went to the trademe my account around the same time, they would see your session.
 - Vodafone / TCL seem to constantly have reports of stale webpages but as mentioned above, I am sure these complaints come mostly from those that dont use the correct DNS servers. Though with the ihug/voda/paradi/clear mergers over the years, I dont blame them if they do have the wrong setting somewhere.

Someone above wanted to know some real statistics
A Cachebox serving 300 subscribers with a 180gb cache has an average 10% data served (all protocols) direct from the cache.
Thats caching youtube, http and various other websites (pornhub)
But we dont use caching to save bandwidth - we use it to serve webpages faster and make websites more responsive. Eg. the trademe logo and 80% of the graphics used on a trademe webpage is only 10ms away from the customer rather than 30ms so not a huge deal, but for overseas websites like facebook it makes a huge difference.
I remember watching the stats for when Lady Gaga - Telephone came out. It was one of the first youtube videos in HiDef to be widely watched. That video alone had something like 30gb served up from the cachebox over 2 days.

As caches get bigger, and more subscribers run under one, they become more efficient. So our pair of little 180gb units are quite small - a RAID array with 10x 256gb SSD disks and 3000 subscribers will be much better.
I said we dont have much torrent usage on our network and so bigger ISP's that do use torrent caches will see probably upwards of 40% data served from caches. It therefore makes a huge difference, and is what actually allows them to provide unlimited data plans.

A single subscriber may use 50gb of natural usage. But once you get over 50gb, its usually torrenting - and when you have 3000 subscribers in an example pool, a large number of them will be downloading the same popular torrents - so really, you only need to budget the data plans for 50gb or so per subscriber, and a whole lot of cache serving performance.

In terms of cost savings...
We find that if we convert everything to gigabytes saved as a performance measurement, our smaller units cost us about 90% of what it would normally cost to serve that gigabyte directly. So cost savings are negligible due to the low torrent usage within our subscriber base. But to be honest, its the web page surfing speed that makes it worth it for us. Even if it cost 10% more per gigabyte to serve from a cache, I would still prefer to use the appliansys system.

Ray Taylor
Taylor Broadband (rural hawkes bay)

There is no place like localhost
For my general guide to extending your wireless network Click Here

2277 posts

Uber Geek
+1 received by user: 370


  Reply # 1060595 6-Jun-2014 22:14
Send private message

Talkiet: Very strongly for... 

I must say the responses so far are refreshingly lucid.

Cheers - N

For the sake of discussion I'm going to partly disagree with you because you didn't specifically define content. We already have a lot of content cached locally through Akamai, Google Cache nodes and other CDNs, so as long as the bandwidth is available I don't believe it's a necessity for ISPs to run PeerApps, BlueCoat, Oversi, custom-squid build etc on top of that. 

All power to those ISPs who do though

 1 | 2
View this topic in a long page with up to 500 replies per page Create new topic

Twitter »

Follow us to receive Twitter updates when new discussions are posted in our forums:

Follow us to receive Twitter updates when news items and blogs are posted in our frontpage:

Follow us to receive Twitter updates when tech item prices are listed in our price comparison site:

News »

Intel introduces new NUC kits and NUC mini PCs
Posted 16-Aug-2018 11:03

The Warehouse leaps into the AI future with Google
Posted 15-Aug-2018 17:56

Targus set sights on enterprise and consumer growth in New Zealand
Posted 13-Aug-2018 13:47

Huawei to distribute nova 3i in New Zealand
Posted 9-Aug-2018 16:23

Home robot Vector to be available in New Zealand stores
Posted 9-Aug-2018 14:47

Panasonic announces new 2018 OLED TV line up
Posted 7-Aug-2018 16:38

Kordia completes first live 4K TV broadcast
Posted 1-Aug-2018 13:00

Schools get safer and smarter internet with Managed Network Upgrade
Posted 30-Jul-2018 20:01

DNC wants a safer .nz in the coming year
Posted 26-Jul-2018 16:08

Auldhouse becomes an AWS Authorised Training Delivery Partner in New Zealand
Posted 26-Jul-2018 15:55

Rakuten Kobo launches Kobo Clara HD entry level reader
Posted 26-Jul-2018 15:44

Kiwi team reaches semi-finals at the Microsoft Imagine Cup
Posted 26-Jul-2018 15:38

KidsCan App to Help Kiwi Children in Need
Posted 26-Jul-2018 15:32

FUJIFILM announces new high-performance lenses
Posted 24-Jul-2018 14:57

New FUJIFILM XF10 introduces square mode for Instagram sharing
Posted 24-Jul-2018 14:44

Geekzone Live »

Try automatic live updates from Geekzone directly in your browser, without refreshing the page, with Geekzone Live now.

Are you subscribed to our RSS feed? You can download the latest headlines and summaries from our stories directly to your computer or smartphone by using a feed reader.

Alternatively, you can receive a daily email with Geekzone updates.