variable compression feature request

griffin tucker rsyrsyncryncrys4804280 at griffintucker.id.au
Sat Sep 4 09:36:38 UTC 2021


--compress or -z will compress during data transfer

what about a variable compression rate?

--optimal-compress or -za

monitor the speed of the transfer and the cpu throughput and
automatically find the optimum compression in almost-real-time with
the goal of reduced transfer time

i figure you'd have to mark the last block compressed/sent with extra
data indicating new blocks are using a different compression strength,
and it could work for using multiple algorithms, depending on the data

when decompressing, when detecting a new block, it will indicate
corruption in the archive, but the extra data will revert the error
indication - the `corruption' would only be up until the last block,
so the data remains intact, and the new rate/algo can begin after the
`failed' block

finding the type of data that can be compressed better/faster with
different algorithms will also be taken into account

just an idea



More information about the rsync mailing list