Buildbot: Add easy to interpret build statistics #85

New Issue

Sergey Sharybin · 2024-06-11T09:56:28+02:00

Sergey Sharybin commented

2024-06-11 09:56:28 +02:00

There are some metrics which seem could be accessed from within the buildbot, but they are not really easy to interpert and agregate.
The goal is to make it easy to quantify impact of changes in the build configuration (both buildbot side, and blender-side). The interesting numbers are:

Per-track per-platform wait time before the build actually starts
Per-track per-platform compile time

From the visualization there are a couple of interesting ones:

Over-time (maybe indexed by build number, as plotting time sample on a time scale might become too sparse to read?)
Histogram (with ability to limit the time frame)

For accessing the data something similar to the dashboard script can be used. Possibly would need to have some local cache, to make it possible to run incrementally.

The results can either be visualized using Zabbix, or Grafana at metrics.blender.org

There are some metrics which seem could be accessed from within the buildbot, but they are not really easy to interpert and agregate. The goal is to make it easy to quantify impact of changes in the build configuration (both buildbot side, and blender-side). The interesting numbers are: - Per-track per-platform wait time before the build actually starts - Per-track per-platform compile time From the visualization there are a couple of interesting ones: - Over-time (maybe indexed by build number, as plotting time sample on a time scale might become too sparse to read?) - Histogram (with ability to limit the time frame) For accessing the data something similar to the [dashboard script](https://projects.blender.org/infrastructure/blender-buildbot-www/src/branch/master/source/dashboard/generate-status.py) can be used. Possibly would need to have some local cache, to make it possible to run incrementally. The results can either be visualized using Zabbix, or Grafana at [metrics.blender.org](https://metrics.blender.org/)

Sergey Sharybin added the

Service

Buildbot

label 2024-06-11 09:56:28 +02:00

Sergey Sharybin referenced this issue

2024-06-11 10:40:17 +02:00

Buildbot: Use shared compilation cache #86

Bart van der Braak self-assigned this 2024-07-01 09:42:30 +02:00

Bart van der Braak added this to the DevOps Progress Board project 2024-07-16 12:52:52 +02:00

Bart van der Braak commented

2024-07-30 01:41:13 +02:00

Additional sources:

Additional sources: - https://docs.buildbot.net/latest/developer/metrics.html - https://docs.buildbot.net/latest/developer/stats-service.html - https://github.com/bartvdbraak/buildbot-prometheus - https://discourse.llvm.org/t/buildbot-insights/64648/4

Bart van der Braak added the

Type

Feature

label 2024-08-01 11:26:11 +02:00

Bart van der Braak closed this issue

2024-08-14 10:31:25 +02:00

Bart van der Braak reopened this issue

2024-08-14 10:33:02 +02:00

Bart van der Braak added this to the Buildbot Revamp milestone 2024-10-03 00:33:20 +02:00

Sign in to join this conversation.