CUDA misaligned address error when rendering the image #110175

New Issue

Bilal · 2023-07-16T19:49:25+02:00

Bilal commented

2023-07-16 19:49:25 +02:00

System Information
Operating system: Windows-10-10.0.19045-SP0 64 Bits
Graphics card: NVIDIA GeForce GTX 1660 SUPER/PCIe/SSE2 NVIDIA Corporation 4.5.0 NVIDIA 536.40

Blender Version
Broken: version: 3.6.0, branch: blender-v3.6-release, commit date: 2023-06-27 08:08, hash: c7fc78b81ecb

The error occurs when rendering in a scene. It only occurs on the gpu and consistently occurs on optix and cuda. The scene starts rendering and gets to about 20/40 samples before the error occurs and it completely stops rendering. This happens both in viewport and render modes. Blender cannot be closed normally or go into viewport mode after the error occurs. It just crashes

The GPU is not running out of VRAM, Task manager shows blender barely uses 3GB VRAM before running into the error even though the gpu has 6GB

Misaligned address in CUDA queue copy_from_device (integrator_shade_volume integrator_queued_paths_array)

Exact steps for others to reproduce the error

Open the scene
Render image

I have tried updating drivers, rolling back drivers, using previous versions (all the way back to 3.4)

Test file: https://drive.google.com/file/d/1tVljdX0saq0cKHVK5BYW0UF_AduD5al9/view?usp=drive_link

**System Information** Operating system: Windows-10-10.0.19045-SP0 64 Bits Graphics card: NVIDIA GeForce GTX 1660 SUPER/PCIe/SSE2 NVIDIA Corporation 4.5.0 NVIDIA 536.40 **Blender Version** Broken: version: 3.6.0, branch: blender-v3.6-release, commit date: 2023-06-27 08:08, hash: `c7fc78b81ecb` The error occurs when rendering in a scene. It only occurs on the gpu and consistently occurs on optix and cuda. The scene starts rendering and gets to about 20/40 samples before the error occurs and it completely stops rendering. This happens both in viewport and render modes. Blender cannot be closed normally or go into viewport mode after the error occurs. It just crashes The GPU is not running out of VRAM, Task manager shows blender barely uses 3GB VRAM before running into the error even though the gpu has 6GB `Misaligned address in CUDA queue copy_from_device (integrator_shade_volume integrator_queued_paths_array)` **Exact steps for others to reproduce the error** 1. Open the scene 2. Render image I have tried updating drivers, rolling back drivers, using previous versions (all the way back to 3.4) Test file: https://drive.google.com/file/d/1tVljdX0saq0cKHVK5BYW0UF_AduD5al9/view?usp=drive_link

ghostriderbike_0.vdb

18 MiB

Bilal added the

labels 2023-07-16 19:49:26 +02:00

Pratik Borhade commented

2023-07-17 06:17:03 +02:00

Hi, thanks for the report. Guess .blend file is missing. Could you attach that as well?
Did you overclock the GPU?

Hi, thanks for the report. Guess .blend file is missing. Could you attach that as well? Did you overclock the GPU?

Pratik Borhade added

Status

Needs Information from User

and removed

Status

Needs Triage

labels 2023-07-17 06:17:14 +02:00

Bilal commented

2023-07-17 11:08:19 +02:00

Hmm so this is a bit weird. On my end i used a single frame from the vdb sequence instead of the full sequence and now its rendering fine. It appears the occurs more with a full vdb sequence. Heres the vdb sequence as a zip and the blend file, it wont let me upload the blend here cause of size limits so im putting it on google drive if thats okay:
https://drive.google.com/file/d/1oUPYYjhG4PoNLNwQ32crpIz9CIuDNZGj/view?usp=sharing
https://drive.google.com/file/d/1cP8ZXqmFdSC7_weYKYK3bpTegG4Mt8VB/view?usp=sharing

And no, the gpu isnt overclocked. I did undervolt it but the error still occurs without the undervolt

Hmm so this is a bit weird. On my end i used a single frame from the vdb sequence instead of the full sequence and now its rendering fine. It appears the occurs more with a full vdb sequence. Heres the vdb sequence as a zip and the blend file, it wont let me upload the blend here cause of size limits so im putting it on google drive if thats okay: https://drive.google.com/file/d/1oUPYYjhG4PoNLNwQ32crpIz9CIuDNZGj/view?usp=sharing https://drive.google.com/file/d/1cP8ZXqmFdSC7_weYKYK3bpTegG4Mt8VB/view?usp=sharing And no, the gpu isnt overclocked. I did undervolt it but the error still occurs without the undervolt

Pratik Borhade added

Status

Needs Triage

and removed

Status

Needs Information from User

labels 2023-07-17 12:05:27 +02:00

Bilal commented

2023-07-17 15:45:25 +02:00

Ah, i tried rendering without volumes and got the error in another scene when i tried to surround it with a cube, the error says:

Misaligned address in CUDA queue copy_from_device(integrator_shade_surface_raytrace integrator_sorted_paths_array prefix_sum)

Unfortunately i cant see the full message because blender freezes up if i try to do anything after the error, cant go to solid view, cant close, cant save etc

Ah, i tried rendering without volumes and got the error in another scene when i tried to surround it with a cube, the error says: Misaligned address in CUDA queue copy_from_device(integrator_shade_surface_raytrace integrator_sorted_paths_array prefix_sum) Unfortunately i cant see the full message because blender freezes up if i try to do anything after the error, cant go to solid view, cant close, cant save etc

Bilal commented

2023-07-17 15:58:33 +02:00

Just ran into another one, message was different from last time but blender crashed before i could copy it. I think its definitely some issue between my gpu and blender but i cant deduce what, ive disabled and enabled every setting i can think of but it makes no difference

Pratik Borhade commented

2023-07-18 07:00:29 +02:00

Unfortunately i cant see the full message because blender freezes up if i try to do anything after the error, cant go to solid view, cant close, cant save etc

Start blender from blender_debug_gpu.cmd bath file, this will generate log files in new file-browser window with error information after closing the blender:

> Unfortunately i cant see the full message because blender freezes up if i try to do anything after the error, cant go to solid view, cant close, cant save etc Start blender from `blender_debug_gpu.cmd` bath file, this will generate log files in new file-browser window with error information after closing the blender:

Bilal commented

2023-07-18 13:29:17 +02:00

Here's the error logs, it crashed after about 2 minutes of rendering at sample 20 this time

blender_debug_output.txt

344 KiB

blender_system_info.txt

26 KiB

Pratik Borhade commented

2023-07-19 06:04:12 +02:00

Thanks. Could you try this with factory preferences (maybe one of the activated add-on is interfering)?: File > Defaults > Load Factory Settings

I think its definitely some issue between my gpu and blender but i cant deduce what

Have made any changes to GPU settings or BIOS?

I'll test your updated files on my end.

Thanks. Could you try this with factory preferences (maybe one of the activated add-on is interfering)?: `File > Defaults > Load Factory Settings` > I think its definitely some issue between my gpu and blender but i cant deduce what Have made any changes to GPU settings or BIOS? - - - I'll test your updated files on my end.

Bilal commented

2023-07-19 19:30:07 +02:00

I loaded the vdb files into a new factory default file, no changes to anything except selecting gpu in preferences and setting cycles to gpu compute, error occured at sample 200.

The only changes to BIOS were enabling virtualization and changing boot order.
The GPU is undervolted however i have tried it with factory settings (the default startup file) and the error still occurs

I loaded the vdb files into a new factory default file, no changes to anything except selecting gpu in preferences and setting cycles to gpu compute, error occured at sample 200. The only changes to BIOS were enabling virtualization and changing boot order. The GPU is undervolted however i have tried it with factory settings (the default startup file) and the error still occurs

Bilal commented

2023-07-21 14:52:36 +02:00

It seems the error is occuring in normal scenes now as well.

This scene has no volumes yet the error still occurs (The message is a bit different, but its still misaligned CUDA Address)

It seems the error is occuring in normal scenes now as well. This scene has no volumes yet the error still occurs (The message is a bit different, but its still misaligned CUDA Address)

Bilal commented

2023-07-21 14:53:34 +02:00

Ah, file too big. Here's a google drive link: https://drive.google.com/file/d/1tVljdX0saq0cKHVK5BYW0UF_AduD5al9/view?usp=drive_link

Pratik Borhade commented

2023-07-25 08:47:55 +02:00

Thanks for simple example file. Still not able to replicate (checked with both CUDA & OptiX)

Let's see whether other devs/triagers can reproduce it.

Thanks for simple example file. Still not able to replicate (checked with both CUDA & OptiX) Let's see whether other devs/triagers can reproduce it.

Pratik Borhade changed title from ~~Misaligned address in CUDA queue copy_from_device (integrator_shade_volume integrator_queued_paths_array) error when using Volumes in scene~~ to CUDA misaligned address error when rendering the image

2023-07-25 08:48:39 +02:00

Richard Antalik commented

2023-08-16 05:41:11 +02:00

Can't reproduce with 3060 either

Bilal commented

2023-09-08 19:36:09 +02:00

Its been almost 2 months and the problem still isnt gone. Ive tried updating/rolling back driver versions all the way back to 2021. No other game/software has this issue. Embergen runs like an absolute charm (albeit a bit slow cause its a 1660 super). Unity, unreal etc work great and rendering in eevee is fine. Its only cycles that constantly runs into errors.

Bilal commented

2023-09-08 19:40:51 +02:00

Ah, i forgot to add. Ive narrowed the issue down to volumetrics mainly. Any scene with heavy volumetrics or even the smallest smoke sim (whether imported or in blender) will cause the error.

Germano Cavalcante referenced this issue

2023-10-23 21:13:36 +02:00

CUDA error on RTX 4090 if using Volumetrics in scene #114035

Philipp Oeser commented

2024-01-02 12:17:57 +01:00

Also canoot repro this here

**System Information**
Operating system: Linux-6.6.8-200.fc39.x86_64-x86_64-with-glibc2.38 64 Bits, X11 UI
Graphics card: NVIDIA GeForce RTX 3080 Laptop GPU/PCIe/SSE2 NVIDIA Corporation 4.6.0 NVIDIA 545.29.06
version: 4.0.2, branch: blender-v4.0-release, commit date: 2023-12-05 07:41, hash: `9be62e85b727`

Broken: version: 3.6.0, branch: blender-v3.6-release, commit date: 2023-06-27 08:08, hash: c7fc78b81e

@Kooale325-2 : Have you tried this in newer blender versions? Or a fresh build from https://builder.blender.org/download/daily/ ?

Also canoot repro this here ``` **System Information** Operating system: Linux-6.6.8-200.fc39.x86_64-x86_64-with-glibc2.38 64 Bits, X11 UI Graphics card: NVIDIA GeForce RTX 3080 Laptop GPU/PCIe/SSE2 NVIDIA Corporation 4.6.0 NVIDIA 545.29.06 version: 4.0.2, branch: blender-v4.0-release, commit date: 2023-12-05 07:41, hash: `9be62e85b727` ``` > Broken: version: 3.6.0, branch: blender-v3.6-release, commit date: 2023-06-27 08:08, hash: c7fc78b81ecb @Kooale325-2 : Have you tried this in newer blender versions? Or a fresh build from https://builder.blender.org/download/daily/ ?

Philipp Oeser added

Status

Needs Information from User

and removed

Status

Needs Triage

labels 2024-01-02 12:18:07 +01:00

Germano Cavalcante referenced this issue

2024-01-22 19:37:03 +01:00

CUDA queue error related to integrator_reset_film_convert_combined_half_rgba #117415

Mateo-Martino-1 commented

2024-02-13 00:38:40 +01:00