Improve Blop->fileop management, using a set instead of a list

Forgetting a blob fileop will be much faster with a set. Also remove a wrong and probably unneeded optimization (pathlistmap).