Since kneaddata
operates on massive data & almost always run on Linux architecture with multiple CPUs it would be beneficial to add multithreaded compression libraries like lbzip2
and pigz
, as they may speed up the process substantially. Shaving off sometime in the pipeline would be beneficial.
Regards,
VB