Skip to content

MINOR: Extend OpenSiaDir with `create` flag to create the dir metadata if it doesn't exist

Christopher Schinnerl requested to merge chris/speedup-siadir-creation into master

MERGE REQUEST

MR Guidelines

Overview

This MR adds a new flag to filesystem.OpenSiaDir to create the dir if it doesn't exist. This was added for convenience and correctness. We make use of that in the repair loop which previously wouldn't create dirs and just spam missing dir criticals. This should also significantly speed up the time it takes to repopulate large dirs with .siadir files. Turns out that after running for half a week, our germany portal wasn't able to do so for all its dirs.

This might also fix an issue where we keep trying to push the same unexplored dir to the heap over and over due to too many failures.

Checklist

Review and complete the checklist to ensure that the MR is complete before assigned to an approver.

  • All new methods or updated methods have clear docstrings
  • Testing added or updated for new methods
  • Any new packages are added to Makefile and .gitlab-ci.yml
  • API documentation updated for API updates
  • Module README.md updated for changes to workflow
  • Issue added to Sia-UI repo for new supporting features
  • Changelog File Created

Issues Closed

Edited by Christopher Schinnerl

Merge request reports