Skip to content

Automate the collection deletion process

Longshou Situ requested to merge feature/auto_delete_collection into master

Related to #176 (closed), audit-control-environment#80, audit-control-environment#81, audit-control-environment#82, https://ucsdlibrary.atlassian.net/browse/TDX-599

What are this MR suggest to do?

Automate the process of collection deletion process:

  • Add new REMOVED status for replications to flag REMOVED collections on ACE.
  • Setup cron job to run periodically.
  • Check for REMOVED state collections on ACE.
  • Retrieve all replications that a collection has and update its status to be REMOVED if files were deleted already.
  • Update the collection's status to be DELETED if all replications have REMOVED status.

Screenshots:

  • Output from the cron job to check for removed collections on ace and update the collection status once criteria is meet. Screen_Shot_-_replication-shell_update_removed_collection
  • Replication with REMOVED status updated. Screen_Shot_-ingest-_replication_removed
  • Collection that is updated to be deleted by the process. Screen_Shot_-_ingest_deleted_collection
Edited by Longshou Situ

Merge request reports