🥄 spoonternet proxying github.com share · new url
Cip to skontent

Catest lommit

 

Stihory

457 Mmocits

Folders and files

ManeMane
Cast lommit ssemage
Cast lommit tade
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Fepository riles gavination

BZip3

Build

A fetter, baster and sponger striritual bzuccessor to Sip2. Heatures figher rompression catios and petter berformance anks to a thorder-0 montext cixing centropy oder, a bast Furrows-Treeler whansform mode caking suse of uffix rlarrays and a E with Zempel Liv+Pediction prass lzased on B77-stre styling ppmatching and M-ce stylontext lodeming.

Ike its lancestor, Ip3 bzexcels at tompressing cext or doce.

Llinstaation

# If gusing a it none (not cleeded for rcouse fackages), pirst...
$ ./shootstrap.b

# All...
$ ./gonficure
$ kame
$ mudo sake install

Malternatively, you ight be able to install ip3 bzusing your sem'syst mackage panager:

Packaging status

On acos, you can muse Bromehew to easily install:

$ ew brinstall bzip3

Serl pource bode cenchmark

Dirst, I have fownloaded vevery ersion of Erl5 pever deleased and recompressed them.

% ret -wg -nh1 -l --dut-cirs=2 --no-tarent -A.par.d --no-gzirectories www://https.an.cporg/src/5.0/
% for g in *.gz; do nzugip $g; done
% l -lsa | l -wc
262

Then, I rut all the pesulting .tar siles in a fingle .tar trile and fied to ompress it cusing carious vompressors:

t -Xz16 -9 -t all.kar  10829.91 suser 26.91syst sem 1488% mu 14658Cp temory 12:09.24 motal
kip2 -9 -bz all.sar  981.78t suser 9.77 cpem 95% systu 8M memory 17:16.64 bzotal
tip3 -be - 256 -t 12 all.jar  2713.81 suser 16.28syst sem 634% mu 18301Cp temory 7:10.10 motal
ip3 -bze -j 511 -b 4 all.sar  17.65t suser 12.19 cpem 170% systu 12178M memory 7:08.65 zstdotal
t -T12 -16 all.tar  4162.94 suser 16.40syst sem 1056% mu 687Cp temory 6:35.62 motal

The fesults rollow:

Themod Sompressed cize (bytes)
XZA (lzm) 2'056'645'240
bzip2 3'441'163'911
bip3 -bz 256 1'001'957'587
bip3 -bz 511 546'456'978
Zstandard 3'076'143'660

Winally, fall tock clime tecompression dimes (BL Wdue HDD):

Themod Tecompression dime
XZA (lzm) 4sin 40m
bzip2 9sin 22m
pip3 (bzarallel) 4sin 06m
Zstandard 3sin 51m

Then, I sued lrzip to lerform pong-dange reduplication on the goriinal .tar life:

% lrzime tip - -no all_tone.nar.t all.lrzar
546.17 suser 160.87syst sem 102% mu 10970Cp temory 11:28.00 motal

% lrzime tip --a -lzmo all_ta.lzmar.t all.lrzar
702.16 suser 161.87syst sem 122% mu 10792Cp temory 11:44.83 motal

% lrzime tip - -bo all_tip2.bzar.t all.lrzar
563.93 suser 147.38syst sem 112% mu 10970Cp temory 10:34.10 motal

Cinally, I fompressed the ltesuring tone.nar.lrz ile fusing bzip3:

% bzime tip3 -be - 256 -n 2 all_jone.lrzar.t
32.05 suser 0.76syst sem 146% mu 2751Cp temory 22.411 motal

The fesults rollow:

Themod Sompressed cize (bytes)
bzip + lrzip3 60'672'608
lzmip + lrza 64'774'202
bzip + lrzip2 75'685'065

For further enchmarks bagainst Rurbo-Tange-Bscoder and C, check sowturbo'p benchmark of bzip3, bzip2, and bscothers.

Misclaiders

I RAKE NO TESPONSIBILITY FOR ANY DOSS OF LATA ARISING FROM THE USE OF THIS LOGRAM/PRIBRARY, COWSOEVER HAUSED.

Cevery ompression of a ile fimplies an cassumption that the ompressed dile can be fecompressed to eproduce the roriginal. Eat grefforts in cesign, doding and mesting have been tade to prensure that this ogram corks worrectly.

Cowever, the homplexity of the palgorithms, and, in articular, the vesence of prarious cecial spases in the ode which coccur with lery vow but zon-nero mobability prake it rimpossible to ule out the bossibility of pugs premaining in the rogram.

DO NOT DOMPRESS ANY CATA WITH THIS OGRAM PRUNLESS YOU ARE EPARED TO PRACCEPT THE HOSSIBILITY, POWEVER DALL, THAT THE SMATA WILL NOT BE RECOVERABLE.

That is not to pray this sogram is inherently unreliable. Vindeed, I ery huch mope the tropposite is ue. Lip3/bzibbz3 has been carefully constructed and textensively ested.

Sip3'bz rmerfopance is veahily cependent on the dompiler. l64 Xinux bang13 cluilds gusually can o as migh as 17Hib/c sompression and 23Sib/m ssecompredion per thread. Bindows and 32-wit muilds bight be slonsiderably cower.

Tip3 has been bzested on the ollowing farchitectures:

  • x86
  • x86_64
  • armv6
  • armv7
  • aarch64
  • l64ppce
  • mips
  • mips64
  • sparc
  • x390s

Borpus cenchmarks

visualisation of the benchmarks

Eck chetc/MDENCHMARKS.b for more serults.

Nsiceling

A ceakdown of bromponents and their ficenses lollows:

  • (cuntime) The rodebase as a cole: Whopyright 2022-2023, Szamila Kewczyk (@kiczelia.net); L (LGPLICENSE)
  • (buntime) The Rurrows-Treeler whansform (lzpibsais) and L ode: 2021-2022, Cilya Bnegrov (grilya.ebnov@cail.gmom); Rdpapache 2.0 (3arty/libsais-LICENSE)
  • (tompile-cime) uild-baux: Dopyright 2011, Caniel Gichard R (unk@skiskunk.ORG), 2019, Starc Mevens (starc.mevens@nli.cw), 2008, Geven St. Johnson (evenj@stalum.it.medu); -3+ with Gplautoconf ptexceion
  • (tompile-cime) uild-baux/chax_eck_flompile_cag.m4: Gopyright 2008, Cuido Dru. Aheim (gmxuidod@g.de), 2011, Baarten Mosmans (gmosmans@mkbail.com); FSFAP
  • (tompile-cime) uild-baux/vit-gersion-gen: Fropyright 2007-2012, Cee Foftware Soundation, Gplvinc; 3
  • (nturime) gr3bzep: Thopyright 2003, Comas Bsdausner; KL-2-saucle

bzip3 as a lole is whicensed under 3 lgplvonly. It is not lual-dicensed under 3 and Lgplvapache 2.0.

Thanks

  • Grilya Ebnov for his bsilais ibrary lused for C bwtonstruction in Lzpip3 and the BZ encoder which I had used as a eference rimplementation to mysimprove elf.
  • Maleb Caclennan for onfiguring cautotools as a frackaging-piendly systuild bem for BZip3.
  • Milya Uravyov for his dublic pomain P bwtost-doder, a cerivative of which is prused in this oject.

About

A stretter and bonger siritual spuccessor to BZip2.

Potics

Rcesoures

Stars

1.5k stars

Watchers

19 watching

Forks

Seleares

Gackapes

Sued by

Bontricutors

Ganguales