Error deleting storage folder - but folder is gone!
Stack Trace or error message
too many open files
I had a very bad error from siad and it looks like it lost some data!
In the SIA UI, I deleted a storage folder. It started moving its data around to other folders (I have lots of space available to store that data). But after a while it gave me an error: too many open files. Although I have already increased the number of max files to 9000.
The problem is that now that storage folder is gone. And I'm 100% sure that it didn't have the time to transfer everything to other folders (150 Gb). Which means that the network still believes that I hold the data, but I don't. There are multiple problems here:
- first, and because in Sia there is so much collateral, I might lose the equivalent of months of hosting just because of a bug (it happened on several folders, probably lost around 300+ Gb which is huge),
- second and most important, the network believes it has redundancy on those stored files, but it hasn't, which poses a serious problem.
Please fix this bug: at least when anything bad happens, don't scratch the directory so that we can recover the data that was left in it later!
How to reproduce it (as minimally and precisely as possible)
Leave the number of max open files low and try to delete a storage folder, it should crash easily and lose your data.
- Sia version: 1.3.7
- OS: Ubuntu 14