Persistent data –> Out of GPU memory (macOS) #110520

New Issue

Open

opened 2023-07-27 09:03:06 +02:00 by vintezis · 9 comments

vintezis commented

2023-07-27 09:03:06 +02:00

System Information
Operating system: MacOS 12.6.6
Graphics card: M1

Blender Version
Broken: 3.6.1
Worked: (newest version of Blender that worked as expected)

Short description of error
If "Persistent data" checkbox is on, after a couple of frames rendering, Blender is quits or just says "Out of GPU memory" (a MacOS bugreport and screenshots are attached)

If I turn OFF persistent data switcher, animation rendering is working fine. It seems, the data is persistent, but the BVH loading happens on all frames, so the memory filling up.

Exact steps for others to reproduce the error

Download and open the attached .blend file.
Navigate to the 'Render' tab in the top menu.
Select 'Render Animation' from the dropdown menu.
Allow a few frames to render.

GPU-memory-OUT.blend.zip

**System Information** Operating system: MacOS 12.6.6 Graphics card: M1 **Blender Version** Broken: 3.6.1 Worked: (newest version of Blender that worked as expected) **Short description of error** If "Persistent data" checkbox is on, after a couple of frames rendering, Blender is quits or just says "Out of GPU memory" (a MacOS bugreport and screenshots are attached) If I turn OFF persistent data switcher, animation rendering is working fine. It seems, the data is persistent, but the BVH loading happens on all frames, so the memory filling up. **Exact steps for others to reproduce the error** - Download and open the attached .blend file. - Navigate to the 'Render' tab in the top menu. - Select 'Render Animation' from the dropdown menu. - Allow a few frames to render. [GPU-memory-OUT.blend.zip](attachments/e51278a9-bb5f-4ecb-b08b-1d02254a7f9d)

Error-Report-Blender361.rtf

171 KiB

SCR-20230727-c7x.jpeg

1.4 MiB

SCR-20230727-c70.jpeg

1.7 MiB

vintezis added the

labels 2023-07-27 09:03:07 +02:00

YimingWu added the

label 2023-07-27 16:59:04 +02:00

Germano Cavalcante commented

2023-07-27 17:37:05 +02:00

Member

Could you provide a simplified file, or mention any of the Demo-Files so we can replicate the problem?

Could you provide a simplified file, or mention any of the [Demo-Files](https://www.blender.org/download/demo-files/) so we can replicate the problem?

Pratik Borhade added

Needs Information from User

and removed

labels 2023-07-28 07:55:55 +02:00

vintezis commented

2023-08-23 08:46:24 +02:00

Author

It seems the link for the blender file disappeared...

Im trying to upload to here directly.

It seems the link for the blender file disappeared... Im trying to upload to here directly.

GPU-memory-OUT.blend.zip

23 MiB

Iliya Katushenock added the

Render & Cycles

label 2023-08-23 13:53:53 +02:00

Pratik Borhade commented

2023-08-30 07:14:02 +02:00

Member

Unable to confirm on windows (4.0, 8a735d0aa4c7). ~1.6GB VRAM was utilized during the render by persistent data cache.
@vintezis , are you rendering on CPU or GPU? How much RAM/VRAM you have? And how much is utilized during render?

**System Information**
Operating system: Windows-10-10.0.22000-SP0 64 Bits
Graphics card: NVIDIA GeForce RTX 3050 Laptop GPU/PCIe/SSE2 NVIDIA Corporation 4.6.0 NVIDIA 532.03

Unable to confirm on windows (4.0, `8a735d0aa4c7`). ~1.6GB VRAM was utilized during the render by persistent data cache. @vintezis , are you rendering on CPU or GPU? How much RAM/VRAM you have? And how much is utilized during render? ``` **System Information** Operating system: Windows-10-10.0.22000-SP0 64 Bits Graphics card: NVIDIA GeForce RTX 3050 Laptop GPU/PCIe/SSE2 NVIDIA Corporation 4.6.0 NVIDIA 532.03 ```

vintezis commented

2023-08-30 09:55:21 +02:00

Author

As you see on screenshots its macOS on M1 SoC. RAM is 16GB unified memory and of course GPU rendering is set.

It seems to me in this case persistent data always added to the previous dataset from previous frame. Thats why the RAM is overflowing.

As you see on screenshots its macOS on M1 SoC. RAM is 16GB unified memory and of course GPU rendering is set. It seems to me in this case persistent data always added to the previous dataset from previous frame. Thats why the RAM is overflowing.

Pratik Borhade commented

2023-08-30 10:44:18 +02:00

Member

It seems to me in this case persistent data always added to the previous dataset from previous frame. Thats why the RAM is overflowing.

Increase in memory usage is expected as said in the manual: https://docs.blender.org/manual/en/dev/render/cycles/render_settings/performance.html#final-render

are you rendering on CPU or GPU

This is still unanswered 😅

Could this be mac specific? @mano-wii will you be able to test on mac system?

> It seems to me in this case persistent data always added to the previous dataset from previous frame. Thats why the RAM is overflowing. Increase in memory usage is expected as said in the manual: https://docs.blender.org/manual/en/dev/render/cycles/render_settings/performance.html#final-render > are you rendering on CPU or GPU This is still unanswered 😅 Could this be mac specific? @mano-wii will you be able to test on mac system?

vintezis commented

2023-08-31 10:31:39 +02:00

Author

are you rendering on CPU or GPU

This is still unanswered 😅

the error message is "Out of GPU memory" and i wrote in previous comment "GPU rendering was set".... so yes im using GPU for rendering

If this is mac specific then its 3.6 (or 3.5) specific also because about one year ago wasn't any problem with this file on the same computer.

> > are you rendering on CPU or GPU > > This is still unanswered 😅 the error message is "Out of GPU memory" and i wrote in previous comment "GPU rendering was set".... so yes im using GPU for rendering If this is mac specific then its 3.6 (or 3.5) specific also because about one year ago wasn't any problem with this file on the same computer.

Pratik Borhade commented

2023-08-31 10:54:34 +02:00

Member

Ah, right. Title itself mentions the word "GPU"
I'll reset the status.

Ah, right. Title itself mentions the word "GPU" I'll reset the status.

Pratik Borhade added

and removed

Needs Information from User

labels 2023-08-31 10:54:47 +02:00

Pratik Borhade commented

2023-09-26 06:40:44 +02:00

Member

Could be related to #106552
There might be memory leak when rendering with Persistent data, hence the higher memory usage (~18 GB as shown in the screen shot)
Could you check this issue again in recent 4.0 build?: https://builder.blender.org/download/daily/

Could this be mac specific? @mano-wii will you be able to test on mac system?

Could be related to #106552 There might be memory leak when rendering with Persistent data, hence the higher memory usage (~18 GB as shown in the screen shot) Could you check this issue again in recent 4.0 build?: https://builder.blender.org/download/daily/ > Could this be mac specific? @mano-wii will you be able to test on mac system? @mano-wii ^

Pratik Borhade added

Needs Information from User

and removed

labels 2023-09-26 06:41:14 +02:00

Germano Cavalcante commented

2023-09-26 16:49:03 +02:00

Member

I can confirm by rendering just 1 of the frames in the attached file. (Which helps since each frame takes 17 minutes to render).
I tested on 4.0 and monitored activity to check memory. The RAM memory is no more than 8GB.
I imagined that b7fe84d9bc might improve this situation.

Read blend: "/Users/germanocavalcante/Downloads/Gold Rings 01, HDRI.blend"
2023-09-26 11:33:39.061951-0300 Blender[38572:158893] [Window] Warning: Window CocoaWindow 0x114c37200 ordered front from a non-active application and may order beneath the active application's windows.
2023-09-26 11:33:50.270198-0300 Blender[38572:164768] mdb_txn_commit error: MDB_MAP_FULL: Environment mapsize limit reached
2023-09-26 11:33:50.317923-0300 Blender[38572:164769] mdb_txn_commit error: MDB_MAP_FULL: Environment mapsize limit reached
2023-09-26 11:33:50.318530-0300 Blender[38572:164768] mdb_txn_commit error: MDB_MAP_FULL: Environment mapsize limit reached
2023-09-26 11:33:50.320249-0300 Blender[38572:164769] mdb_txn_commit error: MDB_MAP_FULL: Environment mapsize limit reached
2023-09-26 11:33:50.320507-0300 Blender[38572:164768] mdb_txn_commit error: MDB_MAP_FULL: Environment mapsize limit reached

(...)

2023-09-26 11:33:50.374728-0300 Blender[38572:164769] mdb_txn_commit error: MDB_MAP_FULL: Environment mapsize limit reached
2023-09-26 11:33:50.375387-0300 Blender[38572:164768] mdb_txn_commit error: MDB_MAP_FULL: Environment mapsize limit reached
2023-09-26 11:33:50.376425-0300 Blender[38572:164769] mdb_txn_commit error: MDB_MAP_FULL: Environment mapsize limit reached
2023-09-26 11:33:50.376956-0300 Blender[38572:164768] mdb_txn_commit error: MDB_MAP_FULL: Environment mapsize limit reached
System is out of GPU memory

Refer to the Cycles GPU rendering documentation for possible solutions:
https://docs.blender.org/manual/en/latest/render/cycles/gpu_rendering.html

2023-09-26 11:39:03.757839-0300 Blender[38572:164767] -[_MTLCommandEncoder dealloc], line 131: error 'Command encoder released without endEncoding'
-[_MTLCommandEncoder dealloc]:131: failed assertion `Command encoder released without endEncoding'

It's possible this is a case where Blender simply ran out of VRAM memory due to the complex scene.
I'm not sure if it's actually a Metal bug.
While we want to improve Blender to handle system running out of memory gracefully, this is not currently considered a bug.

May need investigation from the Cycles team.

I can confirm by rendering just 1 of the frames in the attached file. (Which helps since each frame takes 17 minutes to render). I tested on 4.0 and monitored activity to check memory. The RAM memory is no more than 8GB. I imagined that b7fe84d9bc might improve this situation. ``` Read blend: "/Users/germanocavalcante/Downloads/Gold Rings 01, HDRI.blend" 2023-09-26 11:33:39.061951-0300 Blender[38572:158893] [Window] Warning: Window CocoaWindow 0x114c37200 ordered front from a non-active application and may order beneath the active application's windows. 2023-09-26 11:33:50.270198-0300 Blender[38572:164768] mdb_txn_commit error: MDB_MAP_FULL: Environment mapsize limit reached 2023-09-26 11:33:50.317923-0300 Blender[38572:164769] mdb_txn_commit error: MDB_MAP_FULL: Environment mapsize limit reached 2023-09-26 11:33:50.318530-0300 Blender[38572:164768] mdb_txn_commit error: MDB_MAP_FULL: Environment mapsize limit reached 2023-09-26 11:33:50.320249-0300 Blender[38572:164769] mdb_txn_commit error: MDB_MAP_FULL: Environment mapsize limit reached 2023-09-26 11:33:50.320507-0300 Blender[38572:164768] mdb_txn_commit error: MDB_MAP_FULL: Environment mapsize limit reached (...) 2023-09-26 11:33:50.374728-0300 Blender[38572:164769] mdb_txn_commit error: MDB_MAP_FULL: Environment mapsize limit reached 2023-09-26 11:33:50.375387-0300 Blender[38572:164768] mdb_txn_commit error: MDB_MAP_FULL: Environment mapsize limit reached 2023-09-26 11:33:50.376425-0300 Blender[38572:164769] mdb_txn_commit error: MDB_MAP_FULL: Environment mapsize limit reached 2023-09-26 11:33:50.376956-0300 Blender[38572:164768] mdb_txn_commit error: MDB_MAP_FULL: Environment mapsize limit reached System is out of GPU memory Refer to the Cycles GPU rendering documentation for possible solutions: https://docs.blender.org/manual/en/latest/render/cycles/gpu_rendering.html 2023-09-26 11:39:03.757839-0300 Blender[38572:164767] -[_MTLCommandEncoder dealloc], line 131: error 'Command encoder released without endEncoding' -[_MTLCommandEncoder dealloc]:131: failed assertion `Command encoder released without endEncoding' ``` It's possible this is a case where Blender simply ran out of VRAM memory due to the complex scene. I'm not sure if it's actually a Metal bug. While we want to improve Blender to handle system running out of memory gracefully, this is not currently considered a bug. May need investigation from the Cycles team.

Germano Cavalcante added

Render & Cycles

Needs Info from Developers

and removed

Needs Information from User

Render & Cycles

labels 2023-09-26 16:52:23 +02:00

Sign in to join this conversation.

No Label

Animation & Rigging

Asset Browser Project Overview

Automated Testing

Blender Asset Bundle

Dependency Graph

Development Management

EEVEE & Viewport

Images & Movies

Motion Tracking

Nodes & Physics

Pipeline, Assets & IO

Platforms, Builds & Tests

Render & Cycles

Render Pipeline

Sculpt, Paint & Texture

Video Sequencer

Virtual Reality

Blender 2.8 Project

Milestone 1: Basic, Local Asset Browser

Good First Issue

Animation & Rigging

Development Management

EEVEE & Viewport

Nodes & Physics

Pipeline, Assets & IO

Platforms, Builds & Tests

Render & Cycles

Sculpt, Paint & Texture

Needs Info from Developers

Needs Information from User

No Milestone

No project

No Assignees

3 Participants

Notifications

Due Date

The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: blender/blender#110520

No description provided.