Shameless plug, this is what https://github.com/cpuguy83/tarfs does.
Granted, you do have to traverse the entire tarball.
> Granted, you do have to traverse the entire tarball.
So you can't randomly access a tarball, you can cache the linear access you've already done.
Which is exactly the problem. Same issue occurred via volume and filesystem management resulting in ZFS. We need systems that compose and also elide.
So something that both archives as set of files and compresses them w/o losing affordances over the layer below it in the process.
Shameless plug, this is what https://github.com/cpuguy83/tarfs does.
Granted, you do have to traverse the entire tarball.