New #blog post: Unix Data Compression Shootout

https://rldane.space/unix-data-compression-shootout.html

881 words

cc: my wonderful #chorus: @joel @dm @sotolf @thedoctor @pixx @twizzay @orbitalmartian @adamsdesk @krafter @roguefoam @clayton @giantspacesquid

(I will happily add/remove you from the chorus upon request! :)

#100DaysToOffload #32

#rlDaneWriting #Unix #Linux #BSD #DataCompression #gzip #bzip #bzip2 #bzip3 #zstd #zst #xz #lz4 #compression

I love playing around with #compression

In this case, it's all text-based data in csv and xml formats.

Size:

32,696,320 202411.tar
 4,384,020 202411.tar.bz2
 4,015,912 202411.tar.zst
 3,878,583 202411.tar.bz3
 3,730,416 202411.tar.xz

zstd was invoked using zstd --ultra -22
xz was invoked using xz -9e
bzip2 was invoked using bzip2 -9
bzip3 has no compression level options

Speed:

zstd    54.31user 0.25system 0:54.60elapsed 99%CPU
xz      53.80user 0.06system 0:53.93elapsed 99%CPU
bzip2    5.33user 0.01system 0:05.35elapsed 99%CPU
bzip3    3.98user 0.02system 0:04.01elapsed 99%CPU

Maximum memory usage (RSS):

zstd    706,312
xz      300,480
bzip3    75,996
bzip2     7,680

*RSS sampled up to ten times per second during execution of the commands in question

#bzip3 is freaking amazing, yo.

#DataCompression #bzip #bz3 #zstd #zst #zstandard #xz #lzma
#CouldaBeenABlost ;)

Ah, so there was a bzip1 (technically, bzip 0.21):

https://web.archive.org/web/19980704181204/http://www.muraroa.demon.co.uk/

By way of https://unix.stackexchange.com/questions/125798/what-happened-to-bzip1

#bzip #bzip1 #bzip2 #bzip3

#zip #zlib #bzip #history
技術 / 歴史 / zip,gzip,zlib,bzip2
https://www.glamenv-septzen.net/view/495

Trabalhando com o tar no linux
Os arquivos tarball são distribuições de software livre que mantêm uma estrutura de diretórios, arquivos fonte, um arquivo Makefile, documentação e outros arquivos, encapsulados em um arquivo tar com compressão de dados gzip.

Este método de distribuição de software é muito popular porque os utilitários tar e gzip são muito
https://www.certificacaolinux.com.br/trabalhando-com-o-tar-no-linux/
#bzip #gzip #Linux #tar #tar.bz #tar.gz #tarball