Replace diff syncing for bit syncing
At the moment, we're using diffs to sync the information between the web IDE editor and the build service. We have recently discovered that we have a major blocker here: binary files.
We can't generate diffs for binary files, consequently, using the current approach, we would need to add an endpoint where we could upload the whole file. This option is not sustainable.
In order to make the syncing process agile and lightweight, we have to move to a different approach, the one rsync
does. rsync
uses a bit syncing approach which will allow as sync binary files, as well as text files.
The problem we have to face with this approach is that there is no magic tool or solution. We have to implement or adapt a lib with this algorithm and pray that we have a compatible version in Javascript.