WIP: Tests: Add option to run GPU tests on buildbot #2

Closed
Brecht Van Lommel wants to merge 3 commits from gpu-tests into main

When changing the target branch, be careful to rebase the branch in your fork to match. See documentation.

Currently on macOS (Apple Silicon) and Linux (NVIDIA).

Enable with command @blender-bot build +gpu.

Future work

  • Check if we need more granular control (cycles, eevee, workbench, hydra)
  • Reconsider WITH_GPU_RENDER_TESTS_SILENT cmake option
  • Nightly builder

Ref infrastructure/blender-projects-platform#46

Currently on macOS (Apple Silicon) and Linux (NVIDIA). Enable with command `@blender-bot build +gpu`. Future work * Check if we need more granular control (cycles, eevee, workbench, hydra) * Reconsider `WITH_GPU_RENDER_TESTS_SILENT` cmake option * Nightly builder Ref infrastructure/blender-projects-platform#46
Brecht Van Lommel added 1 commit 2024-02-15 19:36:29 +01:00
Brecht Van Lommel force-pushed gpu-tests from a0ed6bfc30 to 2ea2d98140 2024-02-15 19:42:05 +01:00 Compare
Brecht Van Lommel changed title from Tests: Add option for GPU tests on Linux to Tests: Add option to run GPU tests on buildbot 2024-02-15 19:42:54 +01:00
Brecht Van Lommel changed title from Tests: Add option to run GPU tests on buildbot to WIP: Tests: Add option to run GPU tests on buildbot 2024-02-15 19:43:49 +01:00
Author
Owner

CC @fclem @pragma37 @Jeroen-Bakker @Sergey for visibility, this is not ready yet.

Relevant links:

eevee_next_bsdf tests are timing out a lot on both macOS and Linux (because of not console output for 10 minutes). It seems to get a bit further on the next run, I guess due to cached shaders.

CC @fclem @pragma37 @Jeroen-Bakker @Sergey for visibility, this is not ready yet. Relevant links: * Test build: https://builder-uatest.blender.org/admin/#/builders/50/builds/55 * blender-bot changes: infrastructure/blender-bot@f499f01b3aac97b8242a923dcf2c14abcd9e3679 `eevee_next_bsdf` tests are timing out a lot on both macOS and Linux (because of not console output for 10 minutes). It seems to get a bit further on the next run, I guess due to cached shaders.
Brecht Van Lommel added 1 commit 2024-02-16 19:49:49 +01:00
2a18b38873 Tweaks:
* Upload test reports for GPU test builds only, so they are complete
* Use the NVIDIA machine exclusive for GPU builds for now
Author
Owner

Turns out this was running on Mesa. With NVIDIA the tests run in 23 minutes, which seems acceptable.

This is probably in a good enough state to just enable in PROD next week and refine further.

@Sergey, I had to do these extra steps. Was going to add them to the provisioning scripts. But I did not find instructions for the driver installation there so not sure where to add this.

sudo dnf install nvidia-driver-NVML-545.23.08-1.el8.x86_64
# Running this once creates /dev/nvidia*
sudo nvidia-smi
# Now it should work for any user
nvidia-smi
Turns out this was running on Mesa. With NVIDIA the tests run in 23 minutes, which seems acceptable. * Results: https://builder-uatest.blender.org/download/daily/tests/main-linux-x86_64/report.html * Build log: https://builder-uatest.blender.org/admin/#/builders/31/builds/90/steps/6/logs/stdio This is probably in a good enough state to just enable in PROD next week and refine further. @Sergey, I had to do these extra steps. Was going to add them to the provisioning scripts. But I did not find instructions for the driver installation there so not sure where to add this. ``` sudo dnf install nvidia-driver-NVML-545.23.08-1.el8.x86_64 # Running this once creates /dev/nvidia* sudo nvidia-smi # Now it should work for any user nvidia-smi ```
Brecht Van Lommel added 1 commit 2024-02-16 20:07:10 +01:00
Author
Owner

Merged, remaining work is in infrastructure/blender-projects-platform#46.

Merged, remaining work is in infrastructure/blender-projects-platform#46.

Pull request closed

Sign in to join this conversation.
No reviewers
No Label
No Milestone
No Assignees
1 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: infrastructure/blender-devops#2
No description provided.