We're almost finished with a proof of concept of meta feeds for partial replication, and we're working on compiling statistics on how much will it reduce the total payload sizes during replication. For that purpose we built a network simulator to simulate replication at scale: https://github.com/ssb-ngi-pointer/netsim/
That's right, it's using a ton of space. We are currently working on a new protocol extension for SSB targeted at solving exactly this. Here's a presentation from some months ago, https://www.youtube.com/watch?v=LKr208wpr6Y , although our designs have changed a bit during implementation. See also https://github.com/ssb-ngi-pointer/ssb-meta-feeds-spec
We're building this under a grant from the EU Commission, NGI Pointer, read more about it here https://www.manyver.se/blog/2020-10-update
We're almost finished with a proof of concept of meta feeds for partial replication, and we're working on compiling statistics on how much will it reduce the total payload sizes during replication. For that purpose we built a network simulator to simulate replication at scale: https://github.com/ssb-ngi-pointer/netsim/