Geekzone: technology news, blogs, forums
Guest
Welcome Guest.
You haven't logged in yet. If you don't have an account you can register now.
Buying anything on Amazon? Please use the Geekzone Amazon aff link.




1768 posts

Uber Geek
+1 received by user: 45

Trusted

Topic # 98925 9-Mar-2012 01:09 Send private message

I have written a program in PHP (Yup very slow for the job) that basically shuffles the bits of the file to be compressed before being compressed by the standard zip. It can make the zipped file 10% smaller than using zip on the un-shuffled file. It isn't fast as it is 256 times slower than using the normal zip.

I tried to shuffle compressed data files in the hope to get a little more compression but that didn't make any difference. I still have some ideas on a more advanced shuffle that might produce results but php kind of failed at handling further development.

Anyway, I am wondering what to do from here, I would like to try and make an app that for the first case, the shuffle and compression of standard files. There would be no money in it and the idea would be to release it as opensource.

I have been learning a little c++ on the arduino but am lost when it comes to pc c++ development and would like a hand it getting this going.

Any tips or comments welcome.

Create new topic
372 posts

Ultimate Geek
+1 received by user: 50


  Reply # 592657 9-Mar-2012 09:23 Send private message

You may want to compare anything you do come up with to gzip, 7z, bzip2. So far I think bzip2 on --best mode is the smallest. I'm sure there's been many people who have tried what you're doing, but don't let that stop you.






1768 posts

Uber Geek
+1 received by user: 45

Trusted

  Reply # 592767 9-Mar-2012 13:42 Send private message

Thanks Noodles, I can't access those from inside PHP so have not tested them out.
The Scramble is a like a pre-processor so it could send its reorganised bits to 7z or bzip2.

I think others have done this as it's a very simple idea and using the basic shuffle on compressed files returns no benefits.

So I guess the code I'm look for is something that will read in a file for scrambling and output the scrambled file for processing by z7 (or what ever) and then logging the results to see what scramble key works best.

This seems kind of simple for a dos like command, but I have never done anything like that.

I have thought of using Python but I think I would want something faster.


372 posts

Ultimate Geek
+1 received by user: 50


  Reply # 592780 9-Mar-2012 14:11 Send private message

You can use bzip2 inside php: http://www.php.net/manual/en/ref.bzip2.php






1768 posts

Uber Geek
+1 received by user: 45

Trusted

  Reply # 592794 9-Mar-2012 15:23 Send private message

*blush* thanks, will give it a try.

Create new topic




Twitter »
Follow us to receive Twitter updates when new discussions are posted in our forums:



Follow us to receive Twitter updates when news items and blogs are posted in our frontpage:



Follow us to receive Twitter updates when tech item prices are listed in our price comparison site:





Trending now »

Hot discussions in our forums right now:

Click Monday Deals
Created by mrtoken, last reply by Krishant007 on 24-Nov-2014 17:11 (25 replies)
Pages... 2


Gull Employment Dispute.
Created by networkn, last reply by Sidestep on 26-Nov-2014 09:53 (137 replies)
Pages... 8 9 10


The Warehouse pulling R18 games and DVD's
Created by semigeek, last reply by jpoc on 26-Nov-2014 07:59 (50 replies)
Pages... 2 3 4


Current Netflix payment method as of Nov 14 - Cant pay
Created by andynz, last reply by Kiwipixter on 25-Nov-2014 10:45 (33 replies)
Pages... 2 3


Knock off electronics in The Warehouse
Created by jpoc, last reply by wasabi2k on 26-Nov-2014 11:02 (12 replies)

SEO spammers
Created by freitasm, last reply by jamesrt on 24-Nov-2014 16:09 (25 replies)
Pages... 2


Lollipop no more
Created by ronw, last reply by kiwitrc on 26-Nov-2014 11:30 (11 replies)

Voda VDSL, Horrid offnet performance.
Created by TimA, last reply by ckc on 26-Nov-2014 10:54 (31 replies)
Pages... 2 3



Geekzone Live »

Try automatic live updates from Geekzone directly in your browser, without refreshing the page, with Geekzone Live now.

Are you subscribed to our RSS feed? You can download the latest headlines and summaries from our stories directly to your computer or smartphone by using a feed reader.

Alternatively, you can receive a daily email with Geekzone updates.