All the Perl that's Practical to Extract and Report
use Perl Log In
acme (189)
(email not shown publicly)
http://www.astray.com/
Leon Brocard (aka acme) is an orange-loving Perl eurohacker with many varied contributions to the Perl community, including the GraphViz module on the CPAN. YAPC::Europe was all his fault. He is still looking for a Perl Monger group he can start which begins with the letter 'D'.
LZMA
$ gunzip perl-5.10.0.tar.gz
$ cp perl-5.10.0.tar..
$ time gzip -9 perl-5.10.0.tar
real 0m11.490s
user 0m11.405s
sys 0m0.088s
$ cp../perl-5.10.0.tar .
$ time bzip2 -9 perl-5.10.0.tar
real 0m17.501s
user 0m16.857s
sys 0m0.300s
$ cp../perl-5.10.0.tar .
$ time lzma -9 perl-5.10.0.tar
real 2m0.121s
user 1m58.735s
sys 0m0.468s
So it's slow. so what?
$ ls -lh perl-5.10.0.tar*
-rw-r--r-- 1 acme acme 12M 2008-01-08 13:18 perl-5.10.0.tar.bz2
-rw-r--r-- 1 acme acme 15M 2007-12-18 17:41 perl-5.10.0.tar.gz
-rw-r--r-- 1 acme acme 9.4M 2008-01-08 13:19 perl-5.10.0.tar.lzma
Ahhh, it compresses better. How about decompression?
$ time gunzip perl-5.10.0.tar.gz
real 0m2.014s
user 0m0.792s
sys 0m0.192s
$ rm perl-5.10.0.tar
$ time bunzip2 perl-5.10.0.tar.bz2
real 0m6.231s
user 0m4.916s
sys 0m0.252s
$ rm perl-5.10.0.tar
$ time unlzma perl-5.10.0.tar.lzma
real 0m2.093s
user 0m1.752s
sys 0m0.216s
LZMA compresses well and is pretty fast at decompression. Add another tool to your compression toolbox...
help them think they understand.
--Larry Wall
oooh, smaller! (Score:2)
"Development of this algorithm was sponsored by Intel"? :-)
Re: (Score:2)
And 30 minutes to decompress. Very small, but very very slow.
For comparison, the complete history of Perl (Score:1)
So, I started with over a hundred megabytes of tarballs from history.perl.org, and got those down to 6MB of git pack. Once into the Perforce history, I was looking at reducing the ~400MB of Perforce repository even further. After my initial export, it was already something like 250MB of Git pack (I wrote the exporter to make best use of on-the-fly delta compression). I left a fairly aggressive repack on it going, and it took about 30 minutes and left me with these packs [utsl.gen.nz], which are MUCH smaller. The deco
7Zip (Score:2)
I've long used 7-Zip when I'm forced to use a Windows system, but I've never used it's native 7z format (LZMA).
From a quick scan of Wikipedia it seems that the 7z format is LZMA compression with a 64-bit header and optional extras and the plain lzma tool as described by you here is a raw LZMA compression stream. They are incompatible in that the two tools can't yet process each others files, which is a shame.
I can see lzma files replacing bzip2 files in my archives now. How much smaller could CPAN be ma
-- "It's not magic, it's work..."
lrzip (Score:1)
It doesn't always compress tighter than LZMA but it's usually much faster.
<pre><tt>
% time lzma perl-5.10.0.tar
real 3m33.665s
user 3m31.538s
sys 0m0.530s
% ls -l perl-5.10.0.tar.lzma
-rw------- 1 eda eda 10100884 2008-01-25 10:50 perl-5.10.0.tar.lzma
% time lzma -d perl-5.10.0.t
-- Ed Avis ed@membled.com