Brainstorming: Support for 64 kib Sectors
Problem
Skylinks need to reference a full sector. This means that every link always uses up a multiple of 4 MiB right now depending on the number of hosts we upload the file to. Currently this number is 10 by default which causes an upload of 40 MiB of data for every skylink. Even if only a small document with a few bytes is uploaded. This is why the following solution is proposed.
Proposal
If we add support to hosts for storage folders with smaller sectors like 64kib for example, the overhead described above would shrink drastically.
The problem with that approach is that the modules.SectorSize
is currently very entangled with the whole codebase. Many features and tests depend on it. This is why I created this issue to have the whole team brainstorm about this change and provide feedback / concerns about this change.
Brainstorming
The way I thought this would be the most productive is by starting 1 thread on this issue every time something major comes to mind which needs to be changed in order for this proposal to be implemented. This issue will probably stay open for a couple of months but I'd like to encourage everybody to participate to make sure that afterwards we will be able to get a good estimation of what needs to be done.