Support deleting jobs, with Shaman checkout dir

Sybren A. Stüvel commented

2022-07-04 14:51:09 +02:00

Owner

Copy Link

Support deleting jobs from the web interface.

- When submitting new job via Shaman, store the checkout ID in the job's database entry, for reliable removal afterwards. (014c0d3b3d and f413a40f4e)
- Deleting a job (via the API) should delete: (23afbfbea2 and 791d877ff1)
- - all its related entries in the database, such as tasks, blocklists, task dependencies, etc.
- - task log files
- - last-rendered images
- - maybe also the parent of the job-specific storage directory, f.e. after removing flamenco-manager-storage/job-ce2e/ce2eb26b-cce0-4db3-bcdd-98c91361b68f maybe flamenco-manager-storage/job-ce2e is empty and should be removed too
- - Shaman checkout directory (i.e. the files that were submitted for this job). Shaman has its own garbage collection system, so any files that are now unused after job deletion will be cleaned up a number of days later.
- Web interface:
- - Some way to request job deletion
- - Showing "deletion requested" jobs in a different way.
- SocketIO updates:
- - job deletion was requested
- - job deletion completed

Work has started in the job-deletion-#99401 branch.

Support deleting jobs from the web interface. - - [x] When submitting new job via Shaman, store the checkout ID in the job's database entry, for reliable removal afterwards. (014c0d3b3d and f413a40f4e) - - [x] Deleting a job (via the API) should delete: (23afbfbea2 and 791d877ff1) - - [x] all its related entries in the database, such as tasks, blocklists, task dependencies, etc. - - [x] task log files - - [x] last-rendered images - - [x] maybe also the parent of the job-specific storage directory, f.e. after removing `flamenco-manager-storage/job-ce2e/ce2eb26b-cce0-4db3-bcdd-98c91361b68f` maybe `flamenco-manager-storage/job-ce2e` is empty and should be removed too - - [x] Shaman checkout directory (i.e. the files that were submitted for this job). Shaman has its own garbage collection system, so any files that are now unused after job deletion will be cleaned up a number of days later. - - [x] Web interface: - - [x] Some way to request job deletion - - [x] Showing "deletion requested" jobs in a different way. - - [x] SocketIO updates: - - [x] job deletion was requested - - [x] job deletion completed Work has started in the [job-deletion-#99401](https://developer.blender.org/diffusion/F/history/job-deletion-#99401/) branch.

Sybren A. Stüvel commented

2022-07-04 14:51:09 +02:00

Author

Owner

Copy Link

Changed status from 'Needs Triage' to: 'Confirmed'