Geekzone: technology news, blogs, forums
Welcome Guest.
You haven't logged in yet. If you don't have an account you can register now.

1816 posts

Uber Geek
+1 received by user: 51


Topic # 98925 9-Mar-2012 01:09
Send private message

I have written a program in PHP (Yup very slow for the job) that basically shuffles the bits of the file to be compressed before being compressed by the standard zip. It can make the zipped file 10% smaller than using zip on the un-shuffled file. It isn't fast as it is 256 times slower than using the normal zip.

I tried to shuffle compressed data files in the hope to get a little more compression but that didn't make any difference. I still have some ideas on a more advanced shuffle that might produce results but php kind of failed at handling further development.

Anyway, I am wondering what to do from here, I would like to try and make an app that for the first case, the shuffle and compression of standard files. There would be no money in it and the idea would be to release it as opensource.

I have been learning a little c++ on the arduino but am lost when it comes to pc c++ development and would like a hand it getting this going.

Any tips or comments welcome.

Create new topic
457 posts

Ultimate Geek
+1 received by user: 83

  Reply # 592657 9-Mar-2012 09:23
Send private message

You may want to compare anything you do come up with to gzip, 7z, bzip2. So far I think bzip2 on --best mode is the smallest. I'm sure there's been many people who have tried what you're doing, but don't let that stop you.

1816 posts

Uber Geek
+1 received by user: 51


  Reply # 592767 9-Mar-2012 13:42
Send private message

Thanks Noodles, I can't access those from inside PHP so have not tested them out.
The Scramble is a like a pre-processor so it could send its reorganised bits to 7z or bzip2.

I think others have done this as it's a very simple idea and using the basic shuffle on compressed files returns no benefits.

So I guess the code I'm look for is something that will read in a file for scrambling and output the scrambled file for processing by z7 (or what ever) and then logging the results to see what scramble key works best.

This seems kind of simple for a dos like command, but I have never done anything like that.

I have thought of using Python but I think I would want something faster.


457 posts

Ultimate Geek
+1 received by user: 83

  Reply # 592780 9-Mar-2012 14:11
Send private message

You can use bzip2 inside php:

1816 posts

Uber Geek
+1 received by user: 51


  Reply # 592794 9-Mar-2012 15:23
Send private message

*blush* thanks, will give it a try.

Create new topic

Twitter »

Follow us to receive Twitter updates when new discussions are posted in our forums:

Follow us to receive Twitter updates when news items and blogs are posted in our frontpage:

Follow us to receive Twitter updates when tech item prices are listed in our price comparison site:

News »

Air New Zealand experiments with blockchain technology
Posted 23-Nov-2017 15:39

Symantec selects Amazon Web Services to deliver cloud security
Posted 23-Nov-2017 10:40

New Zealand Ministry of Education chooses Unisys for cloud-based education resourcing management system
Posted 22-Nov-2017 22:00

Business analytics software powers profits for NZ wine producers
Posted 22-Nov-2017 21:52

Pyrios strikes up alliance with Microsoft integrator UC Logiq
Posted 22-Nov-2017 21:51

The New Zealand IT services ecosystem - it's all digital down here
Posted 22-Nov-2017 21:49

Volvo to supply tens of thousands of autonomous drive compatible cars to Uber
Posted 22-Nov-2017 21:46

From small to medium and beyond: Navigating the ERP battlefield
Posted 21-Nov-2017 21:12

Business owners: ERP software selection starts (and finishes) with you
Posted 21-Nov-2017 21:11

Why I'm not an early adopter
Posted 21-Nov-2017 10:39

Netatmo launches smart home products in New Zealand
Posted 20-Nov-2017 20:06

Huawei Mate 10: Punchy, long battery life, artificial intelligence
Posted 20-Nov-2017 16:30

Propel launch Disney Star Wars Laser Battle Drones
Posted 19-Nov-2017 21:26

UFB killer app: Speed
Posted 17-Nov-2017 17:01

The case for RSS — MacSparky
Posted 13-Nov-2017 14:35

Geekzone Live »

Try automatic live updates from Geekzone directly in your browser, without refreshing the page, with Geekzone Live now.

Are you subscribed to our RSS feed? You can download the latest headlines and summaries from our stories directly to your computer or smartphone by using a feed reader.

Alternatively, you can receive a daily email with Geekzone updates.