Skip to content

Move updating the siafile metadata outside of bubble

Christopher Schinnerl requested to merge chris/no-siafile-update-in-bubble into master

MERGE REQUEST

MR Guidelines

Overview

This will prevent bubbles from writing to every single siafile in the directory just to update the hosts and health check time. Instead that part of the code is extracted and only called whenever we health check a dir. This reduces CPU usage quite a bit for large dirs.

I think this is the last low hanging fruit when it comes to optimizing md bubbles. For our large portals I'd suggest writing a script that distributes large dirs over many small ones.

Checklist

Review and complete the checklist to ensure that the MR is complete before assigned to an approver.

  • All new methods or updated methods have clear docstrings
  • Testing added or updated for new methods
  • Any new packages are added to Makefile and .gitlab-ci.yml
  • API documentation updated for API updates
  • Module README.md updated for changes to workflow
  • Issue added to Sia-UI repo for new supporting features
  • Changelog File Created

Issues Closed

Edited by Christopher Schinnerl

Merge request reports