Release utilities Crabz , implementing multi-threaded compression and unpacking data, similar to this utility pigz . Both of these utilities are multi-threaded options for GZIP, optimized for work on multi-core systems. Crabz itself differs in what is written in the programming language Rust, unlike the PIGZ utility written in C (and, partly, on C ++), and demonstrates a significant performance gain, in some cases reaching 50%.
on the developer page There is a detailed Comparison The speed of operation of both utilities with various keys and used backends. The measurements were made on semi-trifapebiytes CSV file using as test PC stand based on AMD Ryzen 9 3950x 16-Core Processor and 64 GB DDR4 RAM and on the Ubuntu operating system 20. For those who do not want to dive into a detailed performance analysis, a brief report is prepared:
- Crabz using ZLIB backend is identical to PIGZ by performance;
- using zlib-ng backend to one and a half times faster than PIGZ;
- Crabz with backend rust slightly (5-10%) faster PIGZ.
According to developers, except for higher speed, Crabz, compared with PIGZ, also has the following advantages:
- Crabz with backend Deflate_Rust uses the code fully written on Rust, which is more secure;
- Crabz is a cross-platform and supports Windows that can attract more participants;
- Crabz supports more formats (Gzip, Zlib, Mgzip, BGZF, RAW Deflate and Snap).
Despite the full performance, Crabz is characterized by a developer as a conceptual CLI-tool prototype using the CRATE-package GZP .