Geekzone: technology news, blogs, forums
Welcome Guest.
You haven't logged in yet. If you don't have an account you can register now.

1815 posts

Uber Geek
+1 received by user: 51


Topic # 98925 9-Mar-2012 01:09
Send private message

I have written a program in PHP (Yup very slow for the job) that basically shuffles the bits of the file to be compressed before being compressed by the standard zip. It can make the zipped file 10% smaller than using zip on the un-shuffled file. It isn't fast as it is 256 times slower than using the normal zip.

I tried to shuffle compressed data files in the hope to get a little more compression but that didn't make any difference. I still have some ideas on a more advanced shuffle that might produce results but php kind of failed at handling further development.

Anyway, I am wondering what to do from here, I would like to try and make an app that for the first case, the shuffle and compression of standard files. There would be no money in it and the idea would be to release it as opensource.

I have been learning a little c++ on the arduino but am lost when it comes to pc c++ development and would like a hand it getting this going.

Any tips or comments welcome.

Create new topic
457 posts

Ultimate Geek
+1 received by user: 83

  Reply # 592657 9-Mar-2012 09:23
Send private message

You may want to compare anything you do come up with to gzip, 7z, bzip2. So far I think bzip2 on --best mode is the smallest. I'm sure there's been many people who have tried what you're doing, but don't let that stop you.

1815 posts

Uber Geek
+1 received by user: 51


  Reply # 592767 9-Mar-2012 13:42
Send private message

Thanks Noodles, I can't access those from inside PHP so have not tested them out.
The Scramble is a like a pre-processor so it could send its reorganised bits to 7z or bzip2.

I think others have done this as it's a very simple idea and using the basic shuffle on compressed files returns no benefits.

So I guess the code I'm look for is something that will read in a file for scrambling and output the scrambled file for processing by z7 (or what ever) and then logging the results to see what scramble key works best.

This seems kind of simple for a dos like command, but I have never done anything like that.

I have thought of using Python but I think I would want something faster.


457 posts

Ultimate Geek
+1 received by user: 83

  Reply # 592780 9-Mar-2012 14:11
Send private message

You can use bzip2 inside php:

1815 posts

Uber Geek
+1 received by user: 51


  Reply # 592794 9-Mar-2012 15:23
Send private message

*blush* thanks, will give it a try.

Create new topic

Twitter »

Follow us to receive Twitter updates when new discussions are posted in our forums:

Follow us to receive Twitter updates when news items and blogs are posted in our frontpage:

Follow us to receive Twitter updates when tech item prices are listed in our price comparison site:

News »

Red Hat unveils production-ready open source hyperconverged infrastructure
Posted 23-Jun-2017 22:10

Whatever ailed Vodafone broadband … seems to be fixed
Posted 23-Jun-2017 14:10

VMware NSX Meets Stringent Government Security Standards with Common Criteria Certification
Posted 22-Jun-2017 19:05

Brother launches next-generation colour laser printers and all-in- ones for business
Posted 22-Jun-2017 18:56

Intel and IOC announce partnership
Posted 22-Jun-2017 18:50

Samsung Galaxy Tab S3: Best Android tablet
Posted 21-Jun-2017 12:05

Wellington-based company helping secure Microsoft browsers
Posted 20-Jun-2017 20:51

Endace delivers high performance with new 1/10/40 Gbps packet capture card
Posted 20-Jun-2017 20:50

You can now integrate SMX security into Microsoft Office 365, Google and other cloud email platforms
Posted 20-Jun-2017 20:47

Ravensdown launches new decision-making tool HawkEye
Posted 19-Jun-2017 15:38

Spark planning to take on direct management of all consumer stores
Posted 19-Jun-2017 10:03

Qrious acquires Ubiquity
Posted 14-Jun-2017 12:21

Spark New Zealand prepares for 5G with Nokia
Posted 14-Jun-2017 12:16

The future-proof 10.5-inch iPad Pro
Posted 13-Jun-2017 18:16

Mandatory data breach reporting in Australia
Posted 13-Jun-2017 11:30

Geekzone Live »

Try automatic live updates from Geekzone directly in your browser, without refreshing the page, with Geekzone Live now.

Are you subscribed to our RSS feed? You can download the latest headlines and summaries from our stories directly to your computer or smartphone by using a feed reader.

Alternatively, you can receive a daily email with Geekzone updates.