Configure zero-downtime deployments #198

New Issue

Oleg-Komarov · 2024-07-01T10:51:39+02:00

Oleg-Komarov commented

2024-07-01 10:51:39 +02:00

Now that we get some sustained traffic, it would be good avoid dropping requests due to uwsgi restart during deploys (502 error).

~~Relying on systemd-managed socket, we should be able to do this with minimal changes to our uwsgi setup.~~

We should use reload instead of restart: https://uwsgi-docs.readthedocs.io/en/latest/articles/TheArtOfGracefulReloading.html#standard-default-boring-graceful-reload-aka-sighup

Now that we get some sustained traffic, it would be good avoid dropping requests due to uwsgi restart during deploys (502 error). ~~Relying on systemd-managed socket, we should be able to do this with minimal changes to our uwsgi setup.~~ We should use reload instead of restart: https://uwsgi-docs.readthedocs.io/en/latest/articles/TheArtOfGracefulReloading.html#standard-default-boring-graceful-reload-aka-sighup

Oleg-Komarov self-assigned this 2024-07-01 10:51:50 +02:00

Oleg-Komarov commented

2024-07-01 11:30:51 +02:00

Testing on staging:

./ansible.sh -i environments/staging install.yaml  --tags uwsgi

brings the service down
to fix:

sudo systemctl enable blender-extensions-staging.socket
sudo systemctl stop blender-extensions-staging.service
sudo systemctl start blender-extensions-staging.socket

UPD: this is no longer relevant, socket unit is not needed
this approach didn't solve the problem of in-flight requests being killed during restart

Testing on staging: ``` ./ansible.sh -i environments/staging install.yaml --tags uwsgi ``` brings the service down to fix: ``` sudo systemctl enable blender-extensions-staging.socket sudo systemctl stop blender-extensions-staging.service sudo systemctl start blender-extensions-staging.socket ``` UPD: this is no longer relevant, socket unit is not needed this approach didn't solve the problem of in-flight requests being killed during restart

Oleg-Komarov commented

2024-07-01 14:32:03 +02:00

Fixed in d3a48372b4

Fixed in https://projects.blender.org/infrastructure/extensions-website/commit/d3a48372b4f3c078ee580c3425d95157054b8d6e

Oleg-Komarov closed this issue

2024-07-01 14:32:03 +02:00

Sign in to join this conversation.