[AMDGPU-pro] Cycles troubles with opencl (CL_OUT_OF_HOST_MEMORY) #50761

Closed
opened 2017-02-23 08:01:09 +01:00 by Pavel · 43 comments

System Information
OS: Ubuntu 16.04
Kernel: 4.10 x86_64
GPU: Radeon R9 280x
Driver: amdgpu-pro-16.60-379184 x86_64

Blender Version
Broken: blender-2.78-7359cc1060-linux-glibc219-x86_64

Short description of error
Cycles render over gpu return OpenCL error (-6): CL_OUT_OF_HOST_MEMORY

Exact steps for others to reproduce the error

  1. Run blender
  2. Configure it to use opencl
  3. Chenge render engine to cycles
  4. Press F12

Attachments
System-info: system-info.txt
Clinfo: clinfo.txt
Blender --gedug-cycles: blender.txt

**System Information** OS: Ubuntu 16.04 Kernel: 4.10 x86_64 GPU: Radeon R9 280x Driver: amdgpu-pro-16.60-379184 x86_64 **Blender Version** Broken: blender-2.78-7359cc1060-linux-glibc219-x86_64 **Short description of error** Cycles render over gpu return OpenCL error (-6): CL_OUT_OF_HOST_MEMORY **Exact steps for others to reproduce the error** 1) Run blender 2) Configure it to use opencl 3) Chenge render engine to cycles 4) Press F12 **Attachments** System-info: [system-info.txt](https://archive.blender.org/developer/F494322/system-info.txt) Clinfo: [clinfo.txt](https://archive.blender.org/developer/F494323/clinfo.txt) Blender --gedug-cycles: [blender.txt](https://archive.blender.org/developer/F494324/blender.txt)
Author

Changed status to: 'Open'

Changed status to: 'Open'
Author

Added subscriber: @Metallikus

Added subscriber: @Metallikus
Member

Added subscriber: @MaiLavelle

Added subscriber: @MaiLavelle
Member

Changed status from 'Open' to: 'Archived'

Changed status from 'Open' to: 'Archived'
Mai Lavelle self-assigned this 2017-02-23 11:13:30 +01:00
Member

Out of host memory means your computer ran out of memory, theres no bug here.

Out of host memory means your computer ran out of memory, theres no bug here.
Author

Changed status from 'Archived' to: 'Open'

Changed status from 'Archived' to: 'Open'
Pavel reopened this issue 2017-02-23 18:20:29 +01:00
Author

In #50761#418998, @MaiLavelle wrote:
Out of host memory means your computer ran out of memory, theres no bug here.

  1. My card have 3Gb memory.
  2. I get this error when rendering the starting cube.
  3. I have no this error under fglrx.

This is a bug.

> In #50761#418998, @MaiLavelle wrote: > Out of host memory means your computer ran out of memory, theres no bug here. 1) My card have 3Gb memory. 2) I get this error when rendering the starting cube. 3) I have no this error under fglrx. This is a bug.
Member

Added subscriber: @LukasStockner

Added subscriber: @LukasStockner
Member

Considering that the same build of Blender works on a different driver, I'm pretty sure that AMDGPU is to blame here, not Blender.

Considering that the same build of Blender works on a different driver, I'm pretty sure that AMDGPU is to blame here, not Blender.
Member

Changed status from 'Open' to: 'Archived'

Changed status from 'Open' to: 'Archived'
Member

Host memory is system memory, not GPU memory. Either your system ran out of memory or there's a driver bug.

Unless there's some other info you've left out there's nothing we can do, this isn't a bug we can fix in Blender.

Host memory is system memory, not GPU memory. Either your system ran out of memory or there's a driver bug. Unless there's some other info you've left out there's nothing we can do, this isn't a bug we can fix in Blender.
Author

Changed status from 'Archived' to: 'Open'

Changed status from 'Archived' to: 'Open'
Pavel reopened this issue 2017-02-24 08:46:17 +01:00
Author

In #50761#419112, @LukasStockner wrote:
Considering that the same build of Blender works on a different driver, I'm pretty sure that AMDGPU is to blame here, not Blender.

Under fglrx the holders of such cards get another error: https://developer.blender.org/T49465

In #50761#419123, @MaiLavelle wrote:
Host memory is system memory, not GPU memory.

System has 2Gb free RAM and 4Gb swap memory.
Why the default scene uses more than 6Gb memory to render it over amdgpu-pro OpenCL api? Why cycles render over CPU work fine? It is realy not memory leak in cycles engine?

Top output: top.txt

> In #50761#419112, @LukasStockner wrote: > Considering that the same build of Blender works on a different driver, I'm pretty sure that AMDGPU is to blame here, not Blender. Under fglrx the holders of such cards get another error: https://developer.blender.org/T49465 > In #50761#419123, @MaiLavelle wrote: > Host memory is system memory, not GPU memory. System has 2Gb **free** RAM and 4Gb swap memory. Why the default scene uses more than 6Gb memory to render it over amdgpu-pro OpenCL api? Why cycles render over CPU work fine? It is realy not memory leak in cycles engine? Top output: [top.txt](https://archive.blender.org/developer/F495511/top.txt)

Added subscriber: @TomG

Added subscriber: @TomG

This comment was removed by @TomG

*This comment was removed by @TomG*
Member

@TomG that is interesting and might point to something we can fix. Its a different issue than the one in this report tho.

Could either of you test the split kernel branch and see if thats any better?

@TomG that is interesting and might point to something we can fix. Its a different issue than the one in this report tho. Could either of you test the split kernel branch and see if thats any better?

Added subscribers: @tom-37, @mont29

Added subscribers: @tom-37, @mont29

@TomG also, since it’s different issue might be better to report it in different task, better to strictly keep one issue per task. ;)

@TomG also, since it’s different issue might be better to report it in different task, better to strictly keep one issue per task. ;)

Removed subscriber: @tom-37

Removed subscriber: @tom-37

In #50761#419316, @mont29 wrote:
@TomG also, since it’s different issue might be better to report it in different task, better to strictly keep one issue per task. ;)

Ok, I have deleted this comment and open here https://developer.blender.org/T50773

In #50761#419310, @MaiLavelle wrote:
@TomG that is interesting and might point to something we can fix. Its a different issue than the one in this report tho.

Could either of you test the split kernel branch and see if thats any better?

No, I haven't tested split kernel branch. I don't know how.

> In #50761#419316, @mont29 wrote: > @TomG also, since it’s different issue might be better to report it in different task, better to strictly keep one issue per task. ;) Ok, I have deleted this comment and open here https://developer.blender.org/T50773 > In #50761#419310, @MaiLavelle wrote: > @TomG that is interesting and might point to something we can fix. Its a different issue than the one in this report tho. > > Could either of you test the split kernel branch and see if thats any better? No, I haven't tested split kernel branch. I don't know how.
Author

This comment was removed by @Metallikus

*This comment was removed by @Metallikus*
Author

Builded from src blender work fine on fglrx: #49465

Builded from src blender work fine on fglrx: #49465

Added subscriber: @Banditka06

Added subscriber: @Banditka06

Same here. Blender 2.77 on Ubuntu 16.10 + AMDGPU-PRO OpenCL driver (hybrid installation with Padoka:ppa Mesa display driver).
After starting rendering on GPU it throws CL_OUT_OF_HOST_MEMORY. Try again and blender crashes.
Host Memory: 16GB
GPU: AMD Radeon HD7870, 2GB

Same here. Blender 2.77 on Ubuntu 16.10 + AMDGPU-PRO OpenCL driver (hybrid installation with Padoka:ppa Mesa display driver). After starting rendering on GPU it throws CL_OUT_OF_HOST_MEMORY. Try again and blender crashes. Host Memory: 16GB GPU: AMD Radeon HD7870, 2GB

Added subscriber: @Sergey

Added subscriber: @Sergey

This could actually be related to #50968? Sounds somewhat similar at least, @Sergey?

This could actually be related to #50968? Sounds *somewhat* similar at least, @Sergey?

Added subscriber: @nathan-osman

Added subscriber: @nathan-osman

I'm seeing this as well with a Radeon R9 270X (2 GB vRAM), 16 GB of system RAM, and amdgpu 16.60-379184 on Ubuntu 16.04.

I'm seeing this as well with a Radeon R9 270X (2 GB vRAM), 16 GB of system RAM, and amdgpu 16.60-379184 on Ubuntu 16.04.
Member

Added subscriber: @Blendify

Added subscriber: @Blendify
Member

Please try again with a build from https://builder.blender.org/download/

Please try again with a build from https://builder.blender.org/download/

Added subscriber: @capnm

Added subscriber: @capnm

I can confirm the same error message with Ubuntu LTS 16.04 + proprietary AMDGPU-PRO Driver 16.6 :

Blender 2.78 (sub 4), Commit date: 2017-04-01 13:29, Hash 3bf0026bec
bpy.context.scene.cycles.device = 'GPU'
F12 -> 
OpenCL error (-6): CL_OUT_OF_HOST_MEMORY

Additionally Blender then later crashes with a segmentation fault:

OpenCL: Error creating command queue
OpenCL error: CL_INVALID_COMMAND_QUEUE in clEnqueueWriteBuffer(cqCommandQueue, CL_MEM_PTR(mem.device_pointer), CL_TRUE, 0, mem.memory_size(), zero, 0, NULL, NULL)
OpenCL: failed to initialize device.
Writing: /tmp/blender.crash.txt

Crash report: blender.crash.txt

I can confirm the same error message with Ubuntu LTS 16.04 + proprietary [AMDGPU-PRO Driver 16.6 ](http://support.amd.com/en-us/kb-articles/Pages/AMDGPU-PRO-Driver-for-Linux-Release-Notes.aspx): ``` Blender 2.78 (sub 4), Commit date: 2017-04-01 13:29, Hash 3bf0026bec bpy.context.scene.cycles.device = 'GPU' F12 -> OpenCL error (-6): CL_OUT_OF_HOST_MEMORY ``` Additionally Blender then later crashes with a segmentation fault: ``` OpenCL: Error creating command queue OpenCL error: CL_INVALID_COMMAND_QUEUE in clEnqueueWriteBuffer(cqCommandQueue, CL_MEM_PTR(mem.device_pointer), CL_TRUE, 0, mem.memory_size(), zero, 0, NULL, NULL) OpenCL: failed to initialize device. Writing: /tmp/blender.crash.txt ``` Crash report: [blender.crash.txt](https://archive.blender.org/developer/F531809/blender.crash.txt)
Member

This could be a driver issue with GCN 1 cards as all cards mentioned in this report are that generation. I cant reproduce this with the cards I have available, and if it is a driver bug there's nothing that we can do anyways. There is a new version of the drivers released recently you guys could try, but we may have to drop support for these cards.

Please see here for more info regarding supported cards: https://wiki.blender.org/index.php/Dev:Source/Render/Cycles/OpenCL

This could be a driver issue with GCN 1 cards as all cards mentioned in this report are that generation. I cant reproduce this with the cards I have available, and if it is a driver bug there's nothing that we can do anyways. There is a new version of the drivers released recently you guys could try, but we may have to drop support for these cards. Please see here for more info regarding supported cards: https://wiki.blender.org/index.php/Dev:Source/Render/Cycles/OpenCL

Unfortunately you are right, GCN1 arch ;-(
Even after upgrade to the latest AMD driver still the same issue.

OpenGL vendor string: Advanced Micro Devices, Inc.
OpenGL renderer string: AMD Radeon HD 7700 Series
OpenGL core profile version string: 4.5.13474 Core Profile Context 17.10.2
OpenGL core profile shading language version string: 4.50
Unfortunately you are right, GCN1 arch ;-( Even after upgrade to the latest AMD driver still the same issue. ``` OpenGL vendor string: Advanced Micro Devices, Inc. OpenGL renderer string: AMD Radeon HD 7700 Series OpenGL core profile version string: 4.5.13474 Core Profile Context 17.10.2 OpenGL core profile shading language version string: 4.50

clinfo 2.1.16.01.12 (mesa), this seems to be a related bug/error:

 Address bits             32, Little-Endian
 Global memory size       624066560 (595.2MiB)
 Global free memory (AMD) <printDeviceInfo:68: get number of CL_DEVICE_GLOBAL_FREE_MEMORY_AMD : error -33>

clinfo.txt

clinfo 2.1.16.01.12 (mesa), this seems to be a related bug/error: ``` Address bits 32, Little-Endian Global memory size 624066560 (595.2MiB) Global free memory (AMD) <printDeviceInfo:68: get number of CL_DEVICE_GLOBAL_FREE_MEMORY_AMD : error -33> ``` [clinfo.txt](https://archive.blender.org/developer/F565623/clinfo.txt)

Added subscriber: @fablefox

Added subscriber: @fablefox

Changed status from 'Open' to: 'Archived'

Changed status from 'Open' to: 'Archived'
  1. It seems agreed that issue was on GCN1 cards and planned to drop support (?).
  2. Last conversation was on Apr 22.

Archived for now.

1) It seems agreed that issue was on GCN1 cards and planned to drop support (?). 2) Last conversation was on Apr 22. Archived for now.

Added subscriber: @FaresTP

Added subscriber: @FaresTP

Added subscriber: @Tooniis

Added subscriber: @Tooniis

Changed status from 'Archived' to: 'Resolved'

Changed status from 'Archived' to: 'Resolved'

In #50761#429868, @capnm wrote:
clinfo 2.1.16.01.12 (mesa), this seems to be a related bug/error:

Address bits 32, Little-Endian
Global memory size 624066560 (595.2MiB)
Global free memory (AMD) <printDeviceInfo:68: get number of CL_DEVICE_GLOBAL_FREE_MEMORY_AMD : error -33>

clinfo.txt

This is it. Setting some environment variables fixes it: https://community.amd.com/thread/233040

This is a bug in the driver not in Blender.

> In #50761#429868, @capnm wrote: > clinfo 2.1.16.01.12 (mesa), this seems to be a related bug/error: > > Address bits 32, Little-Endian > Global memory size 624066560 (595.2MiB) > Global free memory (AMD) <printDeviceInfo:68: get number of CL_DEVICE_GLOBAL_FREE_MEMORY_AMD : error -33> > > [clinfo.txt](https://archive.blender.org/developer/F565623/clinfo.txt) This is it. Setting some environment variables fixes it: https://community.amd.com/thread/233040 This is a bug in the driver not in Blender.

Changed status from 'Resolved' to: 'Archived'

Changed status from 'Resolved' to: 'Archived'
Sign in to join this conversation.
No Label
Interest
Alembic
Interest
Animation & Rigging
Interest
Asset Browser
Interest
Asset Browser Project Overview
Interest
Audio
Interest
Automated Testing
Interest
Blender Asset Bundle
Interest
BlendFile
Interest
Collada
Interest
Compatibility
Interest
Compositing
Interest
Core
Interest
Cycles
Interest
Dependency Graph
Interest
Development Management
Interest
EEVEE
Interest
EEVEE & Viewport
Interest
Freestyle
Interest
Geometry Nodes
Interest
Grease Pencil
Interest
ID Management
Interest
Images & Movies
Interest
Import Export
Interest
Line Art
Interest
Masking
Interest
Metal
Interest
Modeling
Interest
Modifiers
Interest
Motion Tracking
Interest
Nodes & Physics
Interest
OpenGL
Interest
Overlay
Interest
Overrides
Interest
Performance
Interest
Physics
Interest
Pipeline, Assets & IO
Interest
Platforms, Builds & Tests
Interest
Python API
Interest
Render & Cycles
Interest
Render Pipeline
Interest
Sculpt, Paint & Texture
Interest
Text Editor
Interest
Translations
Interest
Triaging
Interest
Undo
Interest
USD
Interest
User Interface
Interest
UV Editing
Interest
VFX & Video
Interest
Video Sequencer
Interest
Virtual Reality
Interest
Vulkan
Interest
Wayland
Interest
Workbench
Interest: X11
Legacy
Blender 2.8 Project
Legacy
Milestone 1: Basic, Local Asset Browser
Legacy
OpenGL Error
Meta
Good First Issue
Meta
Papercut
Meta
Retrospective
Meta
Security
Module
Animation & Rigging
Module
Core
Module
Development Management
Module
EEVEE & Viewport
Module
Grease Pencil
Module
Modeling
Module
Nodes & Physics
Module
Pipeline, Assets & IO
Module
Platforms, Builds & Tests
Module
Python API
Module
Render & Cycles
Module
Sculpt, Paint & Texture
Module
Triaging
Module
User Interface
Module
VFX & Video
Platform
FreeBSD
Platform
Linux
Platform
macOS
Platform
Windows
Priority
High
Priority
Low
Priority
Normal
Priority
Unbreak Now!
Status
Archived
Status
Confirmed
Status
Duplicate
Status
Needs Info from Developers
Status
Needs Information from User
Status
Needs Triage
Status
Resolved
Type
Bug
Type
Design
Type
Known Issue
Type
Patch
Type
Report
Type
To Do
No Milestone
No project
No Assignees
12 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: blender/blender#50761
No description provided.