studio/flamenco
studio/flamenco
12
30
Fork 38
Code Issues 63 Pull Requests 5 Releases Wiki Activity

Job compilation should survive server restarts #62534

New Issue
Closed
opened 2019-03-13 10:16:05 +01:00 by Sybren A. Stüvel · 6 comments
Sybren A. Stüvel commented 2019-03-13 10:16:05 +01:00
Owner
Copy Link

Currently any running job compilation is aborted when the server restarts. Since job compilation also can take more than a second, we should probably move it to a background process with Celery. Celery is a bit better in finishing the task before shutting down, and we can have a background monitoring operation and re-create any jobts that are stuck in 'under-construction' status.

This actually happened to a Cloud subscriber (https://cloud.blender.org/flamenco/p-5c73c4680ab12b4c191cf8d0/jobs/5c8673670e2ba003b9e4b33b).

Currently any running job compilation is aborted when the server restarts. Since job compilation also can take more than a second, we should probably move it to a background process with Celery. Celery is a bit better in finishing the task before shutting down, and we can have a background monitoring operation and re-create any jobts that are stuck in 'under-construction' status. This actually happened to a Cloud subscriber (https://cloud.blender.org/flamenco/p-5c73c4680ab12b4c191cf8d0/jobs/5c8673670e2ba003b9e4b33b).
Sybren A. Stüvel commented 2019-03-13 10:16:05 +01:00
Author
Owner
Copy Link

Added subscribers: @dr.sybren, @fsiddi

Added subscribers: @dr.sybren, @fsiddi
Michael Soluyanov commented 2019-03-13 10:47:19 +01:00
Copy Link

Added subscriber: @crantisz

Added subscriber: @crantisz
Michael Soluyanov commented 2019-03-13 10:47:19 +01:00
Copy Link

I think it's need to have ability to remove jobs in 'under-construction' status, anyway, even if it will be fixed.

I think it's need to have ability to remove jobs in 'under-construction' status, anyway, even if it will be fixed.
Sybren A. Stüvel commented 2019-03-13 11:38:41 +01:00
Author
Owner
Copy Link

Nope, deletion of those jobs is impossible for a reason. When the job is in that status, its tasks are being created by Flamenco Server, and nobody else should be touching the job.

Nope, deletion of those jobs is impossible for a reason. When the job is in that status, its tasks are being created by Flamenco Server, and nobody else should be touching the job.
Sybren A. Stüvel commented 2022-02-28 13:17:07 +01:00
Author
Owner
Copy Link

Changed status from 'Confirmed' to: 'Archived'

Changed status from 'Confirmed' to: 'Archived'
Sybren A. Stüvel commented 2022-02-28 13:17:07 +01:00
Author
Owner
Copy Link

A new generation of Flamenco (version 3.0) is in development (in the main branch at https://developer.blender.org/diffusion/F/), so all issues with Flamenco version 2 or older will be archived.

A new generation of Flamenco (version 3.0) is in development (in the `main` branch at https://developer.blender.org/diffusion/F/), so all issues with Flamenco version 2 or older will be archived.
Sign in to join this conversation.
No Branch/Tag Specified
Branches Tags
Labels
Clear labels   
Good First Issue
  
Priority
High

  
Priority
Low

  
Priority
Normal

  
Status
Archived

  
Status
Confirmed

  
Status
Needs Info from Developers

  
Status
Needs Information from User

  
Status
Needs Triage

  
Status
Resolved

  
Type
Bug

  
Type
Design

  
Type
Job Type
Custom Flamenco job type

  
Type
Known Issue

  
Type
Patch

  
Type
Report

  
Type
To Do

No Label
Good First Issue
Priority
High
Priority
Low
Priority
Normal
Status
Archived
Status
Confirmed
Status
Needs Info from Developers
Status
Needs Information from User
Status
Needs Triage
Status
Resolved
Type
Bug
Type
Design
Type
Job Type
Type
Known Issue
Type
Patch
Type
Report
Type
To Do
Milestone
Clear milestone
No items
No Milestone
Assignees
Clear assignees
No Assignees
2 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: studio/flamenco#62534
No description provided.
Delete Branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?