Geekzone: technology news, blogs, forums
Guest
Welcome Guest.
You haven't logged in yet. If you don't have an account you can register now.


tecumseh

3 posts

Wannabe Geek


#11689 6-Feb-2007 15:58
Send private message

Every large file I download is corrupt, as per the thread here and also at gp.

http://www.gpforums.co.nz/thread/348250/?s=

Is there any download manager that slows the download to check for data corruption on the fly? Hash checks on 1MB sections or something, and then automatically re-downloads any corrupt sections?

I don't know if this is even possible...

But Torrent clients do this, so I can download torrents fine. If I could find a way to do this with normal downloads, I would be very happy.

Windows or Mac.

Cheers
Tec

Create new topic
barf
643 posts

Ultimate Geek


  #59884 6-Feb-2007 17:38

this is symptom of ATM congestion/over-subscription, when 53 byte cells are lost (=~40 lost bytes to higher protocol layers?) TCP & PPP's CRC16 check won't always fail. Telecom should know about it already they will have alarms in place.

However, this is mere speculation. Hopefully I'll be proven wrong! (sbiddle, fraktul?)

Stick to using Bittorrent, emule or anything else that uses MD5 hash checks.




Sniffing the glue holding the Internet together

hellonearthisman
1819 posts

Uber Geek

Trusted

#59900 6-Feb-2007 20:12
Send private message

Most download managers should do all that CRC checking on the packets it get sent.

You could try to reduce the number of splits that your download manager breaks the download into.
The more streams u have the more chance of them getting dropped/packet filtered/confusing telecoms stuff.





 
 
 
 


tecumseh

3 posts

Wannabe Geek


  #59993 7-Feb-2007 13:01
Send private message

barf: this is symptom of ATM congestion/over-subscription, when 53 byte cells are lost (=~40 lost bytes to higher protocol layers?) TCP & PPP's CRC16 check won't always fail. Telecom should know about it already they will have alarms in place.

However, this is mere speculation. Hopefully I'll be proven wrong! (sbiddle, fraktul?)


Thanks for the reply. The following bit of info about the cause of the corruption was posted elsewhere:

In short, Telecom have a problem with their Alcatal ASAM equipment, at least in the Ponsonby exchange and are working with Alcatel to find out what's going on. If you can get you line switched over to the Nokia DSLAM then your problems will go away.

I was able to compare a large test file on a host server with what was downloaded over my faulty connection while running an Ethernet capture on both sides (sending and receiving systems), and then identify the packets in error. At the TCP/IP level, the fault shows as a low-order bit swap within a TCP data packet, followed by the reverse low-order bit swap later in the same packet (some multiple of 128 bytes later). The TCP data packet only has a simple checksum on it, and hence this type of bit-swap error is not detected at the TCP/IP level. However the lower transport levels (PPPoA and ATM AAL5) do have CRC checks on their payload which is designed to catch these types of errors. So why are they being ignored? Why aren't the underlying protocols recovering from these bit errors? And have Telecom thought to set up their own test-case and watch the actual ATM cells??


This is why the normal CRC checks are not working, and why I'm looking for some kind of double-checking downloader, like torrent or emule clients do.

Create new topic





News »

Huawei launches IdeaHub Pro in New Zealand
Posted 27-Oct-2020 16:41


Southland-based IT specialist providing virtual services worldwide
Posted 27-Oct-2020 15:55


NASA discovers water on sunlit surface of Moon
Posted 27-Oct-2020 08:30


Huawei introduces new features to Petal Search, Maps and Docs
Posted 26-Oct-2020 18:05


Nokia selected by NASA to build first ever cellular network on the Moon
Posted 21-Oct-2020 08:34


Nanoleaf enhances lighting line with launch of Triangles and Mini Triangles
Posted 17-Oct-2020 20:18


Synology unveils DS16211+
Posted 17-Oct-2020 20:12


Ingram Micro introduces FootfallCam to New Zealand channel
Posted 17-Oct-2020 20:06


Dropbox adopts Virtual First working policy
Posted 17-Oct-2020 19:47


OPPO announces Reno4 Series 5G line-up in NZ
Posted 16-Oct-2020 08:52


Microsoft Highway to a Hundred expands to Asia Pacific
Posted 14-Oct-2020 09:34


Spark turns on 5G in Auckland
Posted 14-Oct-2020 09:29


AMD Launches AMD Ryzen 5000 Series Desktop Processors
Posted 9-Oct-2020 10:13


Teletrac Navman launches integrated multi-camera solution for transport and logistics industry
Posted 8-Oct-2020 10:57


Farmside hits 10,000 RBI customers
Posted 7-Oct-2020 15:32









Geekzone Live »

Try automatic live updates from Geekzone directly in your browser, without refreshing the page, with Geekzone Live now.


Support Geekzone »

Our community of supporters help make Geekzone possible. Click the button below to join them.

Support Geezone on PressPatron



Are you subscribed to our RSS feed? You can download the latest headlines and summaries from our stories directly to your computer or smartphone by using a feed reader.

Alternatively, you can receive a daily email with Geekzone updates.