Gitea: Evaluate API request rate for Blender Release Fixes Collection tool #110

New Issue

Bart van der Braak · 2024-07-29T10:41:12+02:00

2024-07-29 10:41:12 +02:00

Assess and potentially optimize the API request rate for a tool designed by @Alaska and @lichtwerk to collect a list of fixes specific to a Blender release from projects.blender.org.

This tool is being developed to automatically gather fix information for each Blender release using the Gitea API. Currently, the tool makes API requests every 2 seconds to avoid overloading the server, respecting the robots.txt. Given the limited number of requests (less than 1000 per release), there is potential to reduce the interval and speed up the data collection process.

The tool is in the prototype stage and can be viewed here.

API requests are made to https://projects.blender.org/api/v1/repos/blender/blender/issues/{issue_number}.

A sleep timer controls the request interval (currently set to 2 seconds).

Tasks

Evaluate the impact of lowering the request interval to 1 second or 0.5 seconds.
Measure the server load and performance when the script is executed at these intervals.
Determine a safe and efficient request interval that does not risk temporary blocking or server overload.
Update the script with the optimized request interval based on the findings.

Assess and potentially optimize the API request rate for a tool designed by @Alaska and @lichtwerk to collect a list of fixes specific to a Blender release from `projects.blender.org`. This tool is being developed to automatically gather fix information for each Blender release using the Gitea API. Currently, the tool makes API requests every 2 seconds to avoid overloading the server, respecting the `robots.txt`. Given the limited number of requests (less than 1000 per release), there is potential to reduce the interval and speed up the data collection process. The tool is in the prototype stage and can be viewed [here](https://projects.blender.org/Alaska/.profile/src/branch/main/collect_release_fixes/Get%20fixes%20for%20current%20release.py). API requests are made to `https://projects.blender.org/api/v1/repos/blender/blender/issues/{issue_number}`. A sleep timer controls the request interval (currently set to 2 seconds). ## Tasks - [ ] Evaluate the impact of lowering the request interval to 1 second or 0.5 seconds. - [ ] Measure the server load and performance when the script is executed at these intervals. - [ ] Determine a safe and efficient request interval that does not risk temporary blocking or server overload. - [ ] Update the script with the optimized request interval based on the findings.

Bart van der Braak added this to the DevOps Progress Board project 2024-07-29 10:41:16 +02:00

Bart van der Braak changed title from ~~Gitea: Evaluate API request rate for Blender Fixes Collection tool~~ to Gitea: Evaluate API request rate for Blender Release Fixes Collection tool

2024-07-29 10:41:43 +02:00

Bart van der Braak added the

Service

Gitea

label 2024-08-01 11:15:41 +02:00

Bart van der Braak added the

Type

Config

label 2024-08-01 11:20:08 +02:00

Bart van der Braak closed this issue

2024-08-14 10:31:35 +02:00

Bart van der Braak reopened this issue