infrastructure/blender-devops
infrastructure/blender-devops
1
1
Fork 8
Code Pull Requests 4 Activity

WIP: Tests: Add option to run GPU tests on buildbot #2

Closed
Brecht Van Lommel wants to merge 3 commits from gpu-tests into main
pull from: gpu-tests
merge into: infrastructure:main

When changing the target branch, be careful to rebase the branch in your fork to match. See documentation.
Conversation 3 Commits 3 Files Changed 5 +77 -6
Brecht Van Lommel commented 2024-02-15 19:36:28 +01:00
Owner
Copy Link

Currently on macOS (Apple Silicon) and Linux (NVIDIA).

Enable with command @blender-bot build +gpu.

Future work

  • Check if we need more granular control (cycles, eevee, workbench, hydra)
  • Reconsider WITH_GPU_RENDER_TESTS_SILENT cmake option
  • Nightly builder

Ref infrastructure/blender-projects-platform#46

Currently on macOS (Apple Silicon) and Linux (NVIDIA). Enable with command `@blender-bot build +gpu`. Future work * Check if we need more granular control (cycles, eevee, workbench, hydra) * Reconsider `WITH_GPU_RENDER_TESTS_SILENT` cmake option * Nightly builder Ref infrastructure/blender-projects-platform#46
👍 1 ❤️ 1
Brecht Van Lommel added 1 commit 2024-02-15 19:36:29 +01:00
Brecht Van Lommel force-pushed gpu-tests from a0ed6bfc30 to 2ea2d98140 2024-02-15 19:42:05 +01:00 Compare
Brecht Van Lommel changed title from Tests: Add option for GPU tests on Linux to Tests: Add option to run GPU tests on buildbot 2024-02-15 19:42:54 +01:00
Brecht Van Lommel changed title from Tests: Add option to run GPU tests on buildbot to WIP: Tests: Add option to run GPU tests on buildbot 2024-02-15 19:43:49 +01:00
Brecht Van Lommel commented 2024-02-15 20:36:08 +01:00
Author
Owner
Copy Link

CC @fclem @pragma37 @Jeroen-Bakker @Sergey for visibility, this is not ready yet.

Relevant links:

eevee_next_bsdf tests are timing out a lot on both macOS and Linux (because of not console output for 10 minutes). It seems to get a bit further on the next run, I guess due to cached shaders.

CC @fclem @pragma37 @Jeroen-Bakker @Sergey for visibility, this is not ready yet. Relevant links: * Test build: https://builder-uatest.blender.org/admin/#/builders/50/builds/55 * blender-bot changes: infrastructure/blender-bot@f499f01b3aac97b8242a923dcf2c14abcd9e3679 `eevee_next_bsdf` tests are timing out a lot on both macOS and Linux (because of not console output for 10 minutes). It seems to get a bit further on the next run, I guess due to cached shaders.
Brecht Van Lommel added 1 commit 2024-02-16 19:49:49 +01:00 
* Upload test reports for GPU test builds only, so they are complete
* Use the NVIDIA machine exclusive for GPU builds for now
Brecht Van Lommel commented 2024-02-16 19:49:54 +01:00
Author
Owner
Copy Link

Turns out this was running on Mesa. With NVIDIA the tests run in 23 minutes, which seems acceptable.

This is probably in a good enough state to just enable in PROD next week and refine further.

@Sergey, I had to do these extra steps. Was going to add them to the provisioning scripts. But I did not find instructions for the driver installation there so not sure where to add this.

sudo dnf install nvidia-driver-NVML-545.23.08-1.el8.x86_64
# Running this once creates /dev/nvidia*
sudo nvidia-smi
# Now it should work for any user
nvidia-smi
Turns out this was running on Mesa. With NVIDIA the tests run in 23 minutes, which seems acceptable. * Results: https://builder-uatest.blender.org/download/daily/tests/main-linux-x86_64/report.html * Build log: https://builder-uatest.blender.org/admin/#/builders/31/builds/90/steps/6/logs/stdio This is probably in a good enough state to just enable in PROD next week and refine further. @Sergey, I had to do these extra steps. Was going to add them to the provisioning scripts. But I did not find instructions for the driver installation there so not sure where to add this. ``` sudo dnf install nvidia-driver-NVML-545.23.08-1.el8.x86_64 # Running this once creates /dev/nvidia* sudo nvidia-smi # Now it should work for any user nvidia-smi ```
Brecht Van Lommel added 1 commit 2024-02-16 20:07:10 +01:00
Brecht Van Lommel commented 2024-02-19 17:53:54 +01:00
Author
Owner
Copy Link

Merged, remaining work is in infrastructure/blender-projects-platform#46.

Merged, remaining work is in infrastructure/blender-projects-platform#46.

Pull request closed

Please reopen this pull request to perform a merge.
Sign in to join this conversation.
Reviewers
No reviewers
Labels
Clear labels
No items
No Label
Milestone
Clear milestone
No items
No Milestone
Assignees
Clear assignees
No Assignees
1 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: infrastructure/blender-devops#2
No description provided.
Delete Branch "gpu-tests"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?