WIP: Worker Task Structure Overhaul
Overview
This MR takes a bunch of code that Chris and PJ and I have been working on and uses it to overhaul the task structure and work loop for the workers. Things are now divided into sync and async tasks.
A follow-up to this will overhaul projectdownloadbyroot.go to make use of the async tasks. which is when we should see massive improvements to Skynet throughput and latency.
Checklist
Review and complete the checklist to ensure that the MR is complete before assigned to an approver.
-
All new methods or updated methods have clear docstrings -
Testing added or updated for new methods -
Any new packages are added to Makefile and .gitlab-ci.yml -
API documentation updated for API updates -
Module README.md updated for changes to workflow -
Issue added to Sia-UI repo for new supporting features -
Changelog File Created