Large Alembic crashes Blender 4.0 #111575

Open
opened 2023-08-27 02:59:00 +02:00 by Robert Nederhorst · 11 comments

System Information
Operating system: Win11
Graphics card: 4090

Blender Version
Broken: 4.0 Aug 26th build and 3.6 stable build
Worked: n/a

Short description of error

Importing this alembic file causes a segfault:
https://www.dropbox.com/scl/fi/7ty5zf9s8u31swr03m34k/building_06.abc?rlkey=9z8ct3vrt7hhapd6se1gleswg&dl=0

Exact steps for others to reproduce the error
Try to import this file.
This was made with reality capture.

another alembic file from same software does work:
https://www.dropbox.com/scl/fi/7ty5zf9s8u31swr03m34k/building_06.abc?rlkey=9z8ct3vrt7hhapd6se1gleswg&dl=0

Notes:

This is due to overflowing the internal BHead::len field - which is only a signed 32-bit field.

Stack trace:
VCRUNTIME140.dll    :0x00007FFC728B11F0  memcmp
blender.exe         :0x00007FF77712F260  BLO_memfile_chunk_add
blender.exe         :0x00007FF7771210E0  mywrite
blender.exe         :0x00007FF777124430  BLO_write_struct_array_by_name
blender.exe         :0x00007FF776E1B4E0  CustomData_blend_write
blender.exe         :0x00007FF776DAFA70  mesh_blend_write
blender.exe         :0x00007FF777121290  write_file_handle
blender.exe         :0x00007FF777123FC0  BLO_write_file_mem
blender.exe         :0x00007FF77B2FE1D0  BKE_memfile_undo_encode
blender.exe         :0x00007FF777A89D70  memfile_undosys_step_encode
blender.exe         :0x00007FF77B21E0F0  BKE_undosys_step_push_with_type
blender.exe         :0x00007FF77B21DF30  BKE_undosys_step_push
blender.exe         :0x00007FF777A8ACF0  ED_undo_push
**System Information** Operating system: Win11 Graphics card: 4090 **Blender Version** Broken: 4.0 Aug 26th build and 3.6 stable build Worked: n/a **Short description of error** Importing this alembic file causes a segfault: https://www.dropbox.com/scl/fi/7ty5zf9s8u31swr03m34k/building_06.abc?rlkey=9z8ct3vrt7hhapd6se1gleswg&dl=0 **Exact steps for others to reproduce the error** Try to import this file. This was made with reality capture. another alembic file from same software does work: https://www.dropbox.com/scl/fi/7ty5zf9s8u31swr03m34k/building_06.abc?rlkey=9z8ct3vrt7hhapd6se1gleswg&dl=0 Notes: This is due to overflowing the internal `BHead::len` field - which is only a signed 32-bit field. ``` Stack trace: VCRUNTIME140.dll :0x00007FFC728B11F0 memcmp blender.exe :0x00007FF77712F260 BLO_memfile_chunk_add blender.exe :0x00007FF7771210E0 mywrite blender.exe :0x00007FF777124430 BLO_write_struct_array_by_name blender.exe :0x00007FF776E1B4E0 CustomData_blend_write blender.exe :0x00007FF776DAFA70 mesh_blend_write blender.exe :0x00007FF777121290 write_file_handle blender.exe :0x00007FF777123FC0 BLO_write_file_mem blender.exe :0x00007FF77B2FE1D0 BKE_memfile_undo_encode blender.exe :0x00007FF777A89D70 memfile_undosys_step_encode blender.exe :0x00007FF77B21E0F0 BKE_undosys_step_push_with_type blender.exe :0x00007FF77B21DF30 BKE_undosys_step_push blender.exe :0x00007FF777A8ACF0 ED_undo_push ```
Robert Nederhorst added the
Type
Report
Priority
Normal
Status
Needs Triage
labels 2023-08-27 02:59:00 +02:00
Iliya Katushenock added the
Interest
Alembic
label 2023-08-27 03:11:12 +02:00

8 gigabytes....
In theory, you could just hit the model size limit that is generally supported.
If someone reports a crash with an int overflow cause, it will be closed simply as a limit to the supported geometry size.

8 gigabytes.... In theory, you could just hit the model size limit that is generally supported. If someone reports a crash with an int overflow cause, it will be closed simply as a limit to the supported geometry size.
Member
Also share crash logs: https://docs.blender.org/manual/en/dev/troubleshooting/crash.html#windows

Logs attached. I did have someone test this on a non-blender app and there was no crash. So I know the data is good.

Logs attached. I did have someone test this on a non-blender app and there was no crash. So I know the data is good.

Can you also send C:\Users\throb\AppData\Local\Temp\blender.crash.txt?

Can you also send `C:\Users\throb\AppData\Local\Temp\blender.crash.txt`?

My apologies. Here it is.

Rob

My apologies. Here it is. Rob
Iliya Katushenock added the
Interest
Modeling
label 2023-08-28 20:22:05 +02:00

Thanks. It seems CustomData_blend_write can't provide buffer for data. But still not sure what can cause this. May be just not enough memory.

Thanks. It seems `CustomData_blend_write` can't provide buffer for data. But still not sure what can cause this. May be just not enough memory.

This is the same as #110334. It is not an out of memory condition but rather a current limitation. The incoming mesh (maybe called building_06) has 483million+ verts/points and this ends up overflowing one of Blender's core data structures when attempting to save the data - a vec2f so probably some form of UV coordinate or similar attribute (len field wraps around to negative).

image

(int)(483705342 * 8) // 8 == sizeof(vec2f)
-425324560 // very bad

This is a current limitation of Blender with no easy workaround.

This is the same as #110334. It is not an out of memory condition but rather a current limitation. The incoming mesh (maybe called `building_06`) has 483million+ verts/points and this ends up overflowing one of Blender's core data structures when attempting to save the data - a `vec2f` so probably some form of UV coordinate or similar attribute (`len` field wraps around to negative). ![image](/attachments/cb1d618b-8f81-4f63-be16-2d2a53b96c69) ``` (int)(483705342 * 8) // 8 == sizeof(vec2f) -425324560 // very bad ``` This is a current limitation of Blender with no easy workaround.

I tried to be careful in my assumptions, but if you confirm, then yes, it seems that these are just limiting sizes.

I tried to be careful in my assumptions, but if you confirm, then yes, it seems that these are just limiting sizes.

Since #110334 is confirmed, closing this report. Feel free to subscribe to #110334.

Since #110334 is confirmed, closing this report. Feel free to subscribe to #110334.
Blender Bot added
Status
Archived
and removed
Status
Needs Triage
labels 2023-08-29 19:23:38 +02:00

As #110334 was originally about foreach_set, I'd like to keep this one open for the "large mesh" issue since more folks seem to be hitting it directly.

As #110334 was originally about `foreach_set`, I'd like to keep this one open for the "large mesh" issue since more folks seem to be hitting it directly.
Blender Bot added
Status
Needs Triage
and removed
Status
Archived
labels 2023-10-07 08:24:46 +02:00
Jesse Yurkovich added
Module
Core
Status
Confirmed
and removed
Status
Needs Triage
labels 2023-10-07 08:24:57 +02:00

Hi Jesse, I've read your diagnosis in #114154 and you've identified the problem perfectly with my data. I hope you'll be able to adapt Blender's software code to be able to use this kind of data.

As I explained, a decimated version of the 3D model with 65 million facets loads but Blender is in an infinite loop when I try to save the project in Blender format. Saving the imported OBJ 65M doesn't work.

with my thanks for the care and attention given to my report.

David.

Hi Jesse, I've read your diagnosis in #114154 and you've identified the problem perfectly with my data. I hope you'll be able to adapt Blender's software code to be able to use this kind of data. As I explained, a decimated version of the 3D model with 65 million facets loads but Blender is in an infinite loop when I try to save the project in Blender format. Saving the imported OBJ 65M doesn't work. with my thanks for the care and attention given to my report. David.
Sign in to join this conversation.
No Label
Interest
Alembic
Interest
Animation & Rigging
Interest
Asset Browser
Interest
Asset Browser Project Overview
Interest
Audio
Interest
Automated Testing
Interest
Blender Asset Bundle
Interest
BlendFile
Interest
Collada
Interest
Compatibility
Interest
Compositing
Interest
Core
Interest
Cycles
Interest
Dependency Graph
Interest
Development Management
Interest
EEVEE
Interest
EEVEE & Viewport
Interest
Freestyle
Interest
Geometry Nodes
Interest
Grease Pencil
Interest
ID Management
Interest
Images & Movies
Interest
Import Export
Interest
Line Art
Interest
Masking
Interest
Metal
Interest
Modeling
Interest
Modifiers
Interest
Motion Tracking
Interest
Nodes & Physics
Interest
OpenGL
Interest
Overlay
Interest
Overrides
Interest
Performance
Interest
Physics
Interest
Pipeline, Assets & IO
Interest
Platforms, Builds & Tests
Interest
Python API
Interest
Render & Cycles
Interest
Render Pipeline
Interest
Sculpt, Paint & Texture
Interest
Text Editor
Interest
Translations
Interest
Triaging
Interest
Undo
Interest
USD
Interest
User Interface
Interest
UV Editing
Interest
VFX & Video
Interest
Video Sequencer
Interest
Virtual Reality
Interest
Vulkan
Interest
Wayland
Interest
Workbench
Interest: X11
Legacy
Blender 2.8 Project
Legacy
Milestone 1: Basic, Local Asset Browser
Legacy
OpenGL Error
Meta
Good First Issue
Meta
Papercut
Meta
Retrospective
Meta
Security
Module
Animation & Rigging
Module
Core
Module
Development Management
Module
EEVEE & Viewport
Module
Grease Pencil
Module
Modeling
Module
Nodes & Physics
Module
Pipeline, Assets & IO
Module
Platforms, Builds & Tests
Module
Python API
Module
Render & Cycles
Module
Sculpt, Paint & Texture
Module
Triaging
Module
User Interface
Module
VFX & Video
Platform
FreeBSD
Platform
Linux
Platform
macOS
Platform
Windows
Priority
High
Priority
Low
Priority
Normal
Priority
Unbreak Now!
Status
Archived
Status
Confirmed
Status
Duplicate
Status
Needs Info from Developers
Status
Needs Information from User
Status
Needs Triage
Status
Resolved
Type
Bug
Type
Design
Type
Known Issue
Type
Patch
Type
Report
Type
To Do
No Milestone
No project
No Assignees
6 Participants
Notifications
Due Date
The due date is invalid or out of range. Please use the format 'yyyy-mm-dd'.

No due date set.

Dependencies

No dependencies set.

Reference: blender/blender#111575
No description provided.