Stories
Slash Boxes
Comments
NOTE: use Perl; is on undef hiatus. You can read content, but you can't post it. More info will be forthcoming forthcomingly.

All the Perl that's Practical to Extract and Report

The Fine Print: The following comments are owned by whoever posted them. We are not responsible for them in any way.

LZMA 1 Comment More | Login | Reply /

 Full
 Abbreviated
 Hidden
More | Login | Reply
Loading... please wait.
  • Have a look at <a href="http://ck.kolivas.org/apps/lrzip/">lrzip</a> which is a combination of LZMA and rzip. That is, it has a preprocessing stage sorting the data somehow and then does LZMA compression.

    It doesn't always compress tighter than LZMA but it's usually much faster.

    <pre><tt>
    % time lzma perl-5.10.0.tar

    real 3m33.665s
    user 3m31.538s
    sys 0m0.530s
    % ls -l perl-5.10.0.tar.lzma
    -rw------- 1 eda eda 10100884 2008-01-25 10:50 perl-5.10.0.tar.lzma
    % time lzma -d perl-5.10.0.tar.lzma

    real 0m3.247s
    user 0m2.957s
    sys 0m0.250s

    % time lrzip -q perl-5.10.0.tar

    real 1m29.689s
    user 1m28.823s
    sys 0m0.410s
    % ls -l perl-5.10.0.tar.lrz
    -rw------- 1 eda eda 10771148 2008-01-25 10:53 perl-5.10.0.tar.lrz
    </tt></pre>

    So, compression nearly as good, but more than twice as fast. Decompression is fast but not as fast as plain lzma:

    <pre><tt>
    % rm perl-5.10.0.tar
    eda@localhost ~ $ time lrzip -d perl-5.10.0.tar.lrz

    real 0m7.519s
    user 0m4.274s
    sys 0m3.169s
    </tt></pre>

    You can tweak the settings of lrzip to get different space/speed/memory usage tradeoffs.
    --
    -- Ed Avis ed@membled.com
Stories, comments, journals, and other submissions on use Perl; are Copyright 1998-2006, their respective owners.