Regression: Importing of collada model with instances became a LOT slower since 2.80 (practically freezing) #104108

New Issue

Sarah Smith · 2023-01-23T23:51:05+01:00

Sarah Smith commented

2023-01-23 23:51:05 +01:00

System Information
Operating system: windows 10
Graphics card: geforce gtx 1070

Blender Version
Broken: blender 3.4.1
Worked: 2.80

Short description of error
Importing of collada model makes Blender not respond anymore with high CPU usage in windows task manager (and never finishes no matter how long you wait)

Exact steps for others to reproduce the error

import attached collada file
Blender not respond anymore with high CPU usage in windows task manager (and never finishes no matter how long you wait)

Link to model file:

https://3dwarehouse.sketchup.com/model/08a9d48a-9229-4711-b9bb-23adc6c5e98d/Cruisn-Exotica-arcade-game-Dual

doubleexotica.zip

**System Information** Operating system: windows 10 Graphics card: geforce gtx 1070 **Blender Version** Broken: blender 3.4.1 Worked: 2.80 **Short description of error** Importing of collada model makes Blender not respond anymore with high CPU usage in windows task manager (and never finishes no matter how long you wait) **Exact steps for others to reproduce the error** - import attached collada file - Blender not respond anymore with high CPU usage in windows task manager (and never finishes no matter how long you wait) Link to model file: https://3dwarehouse.sketchup.com/model/08a9d48a-9229-4711-b9bb-23adc6c5e98d/Cruisn-Exotica-arcade-game-Dual [doubleexotica.zip](https://archive.blender.org/developer/F14190077/doubleexotica.zip)

Sarah Smith commented

2023-01-23 23:51:05 +01:00

Added subscriber: @blender.girl

Sarah Smith commented

2023-01-24 01:46:41 +01:00

The model can be imported with meshlab

https://www.meshlab.net/

The model can be imported with meshlab https://www.meshlab.net/

Philipp Oeser commented

2023-01-24 10:50:42 +01:00

Added subscriber: @lichtwerk

Philipp Oeser commented

2023-01-24 10:50:42 +01:00

Changed status from 'Needs Triage' to: 'Confirmed'

Philipp Oeser commented

2023-01-24 10:50:42 +01:00

Can confirm.

2.80 was able to import this, checking...

Can confirm. 2.80 was able to import this, checking...

Philipp Oeser commented

2023-01-24 14:19:23 +01:00

Added subscribers: @mont29, @GaiaClary

Philipp Oeser commented

2023-01-24 14:19:23 +01:00

Hm, cant find any obvious code changes that might have caused this on first sight.
I assume though this has something to do with adding objects to collections (the Collada importer uses BKE_collection_object_add_from possibly haven gotten a lot slower...[probably for good reasons though])
I hacked some parts to speed the process up (skipping nested children, using BKE_collection_object_add_notest, ...) and the file does import then...
That being said, there is probably also something wrong with either the .dae or the way blenders Collada importer handles instances.
Like I said, Importing into 2.80 works, but still, I get a whole bunch of duplicates here (the file result in over 30.000 objects (a lot of them are seemingly duplicates).

@GaiaClary , @mont29 might know more...

Hm, cant find any obvious code changes that might have caused this on first sight. I assume though this has something to do with adding objects to collections (the Collada importer uses `BKE_collection_object_add_from` possibly haven gotten a lot slower...[probably for good reasons though]) I hacked some parts to speed the process up (skipping nested children, using `BKE_collection_object_add_notest`, ...) and the file **does** import then... That being said, there is probably also something wrong with either the .dae or the way blenders Collada importer handles instances. Like I said, Importing into 2.80 works, but still, I get a whole bunch of duplicates here (the file result in over 30.000 objects (a lot of them are seemingly duplicates). @GaiaClary , @mont29 might know more...

Philipp Oeser changed title from ~~Importing of collada model makes Blender not respond anymore~~ to Regression: Importing of collada model with instances became a LOT slower since 2.80 (practically freezing)

2023-01-24 14:20:36 +01:00

Bastien Montagne commented

2023-01-24 15:31:59 +01:00

30k objects are indeed not yet properly supported in general... However, changes like D17016: Use a hash for Collection.gobject lookup, improving speed of linking objects may 'solve' these kind of issues, or at least make them much less sensitive.

30k objects are indeed not yet properly supported in general... However, changes like [D17016: Use a hash for Collection.gobject lookup, improving speed of linking objects](https://archive.blender.org/developer/D17016) may 'solve' these kind of issues, or at least make them much less sensitive.

Sarah Smith commented

2023-01-24 18:35:49 +01:00

In #104108#1479147, @lichtwerk wrote:
Like I said, Importing into 2.80 works, but still, I get a whole bunch of duplicates here (the file result in over 30.000 objects (a lot of them are seemingly duplicates).

@GaiaClary , @mont29 might know more...

I think all faces are twice present since on some other models of that website I had to enable backface culling in Blender. So that explains the duplicates (I think)

> In #104108#1479147, @lichtwerk wrote: > Like I said, Importing into 2.80 works, but still, I get a whole bunch of duplicates here (the file result in over 30.000 objects (a lot of them are seemingly duplicates). > > @GaiaClary , @mont29 might know more... I think all faces are twice present since on some other models of that website I had to enable backface culling in Blender. So that explains the duplicates (I think)

Sarah Smith commented

2023-01-24 18:37:38 +01:00

What about adding an importer to Blender in python as an official add-on using this very well updated pycollada python library?

https://github.com/pycollada/pycollada

What about adding an importer to Blender in python as an official add-on using this very well updated pycollada python library? https://github.com/pycollada/pycollada

Rombout Versluijs commented

2023-01-24 19:18:16 +01:00

Added subscriber: @RomboutVersluijs

Rombout Versluijs commented

2023-01-24 19:18:16 +01:00

@blender.girl
Did you look at the bottom of that github , it links to an existing importer/exporter
https://github.com/skrat/bpycollada

@blender.girl Did you look [at the bottom of that github ](https://github.com/pycollada/pycollada#:~:text=COLLADA%20Import%2FExport-,blender%20collada%20importer,-Meshtool), it links to an existing importer/exporter https://github.com/skrat/bpycollada

Sarah Smith commented

2023-01-24 19:57:24 +01:00

Yes, but I can't install it on windows. There is an github issue and I have the same problem. Do you know how to install it?

Scurest commented

2023-01-24 20:30:32 +01:00

Added subscriber: @scurest

Scurest commented

2023-01-24 20:30:32 +01:00

It's 11 years old, it's not going to work with modern Blender.

Gaia Clary commented

2023-01-24 21:16:56 +01:00

In #104108#1479300, @blender.girl wrote:
What about adding an importer to Blender in python as an official add-on using this very well updated pycollada python library?

https://github.com/pycollada/pycollada

I would think that If this freeze on import is an issue related to low level import functions in Blender, then i doubt that a python based importer would improve the situation. I'd rather think a python importer would be even slower then. But all of that is just guessing. also, 30000 imported objects sounds like some issues with list processing in the importer 🤔 as it is not made for such a huge amount of imported items... hmmm

> In #104108#1479300, @blender.girl wrote: > What about adding an importer to Blender in python as an official add-on using this very well updated pycollada python library? > > https://github.com/pycollada/pycollada I would think that If this freeze on import is an issue related to low level import functions in Blender, then i doubt that a python based importer would improve the situation. I'd rather think a python importer would be even slower then. But all of that is just guessing. also, 30000 imported objects sounds like some issues with list processing in the importer 🤔 as it is not made for such a huge amount of imported items... hmmm

Philipp Oeser commented

2023-01-25 09:42:48 +01:00

In #104108#1479297, @blender.girl wrote:
I think all faces are twice present since on some other models of that website I had to enable backface culling in Blender. So that explains the duplicates (I think)

This is not duplicate faces, we have a lot of duplicate objects
For example, we have 369 instances of group_14, we have 369 instances of group_10 etc etc, all parented under 369 instances of instance_0
{F14196210 size=full}

So like I said, to investigate further, I would check the collada file for wrong usage OR check blender importer code (in DocumentImporter::create_instance_node)
There is also the following comment (that is either outdated, or gives us a hint that 979b06f739 was not meant to be fully functional yet)

/* XXX instance_node is not supported yet */

> In #104108#1479297, @blender.girl wrote: > I think all faces are twice present since on some other models of that website I had to enable backface culling in Blender. So that explains the duplicates (I think) This is not duplicate faces, we have a lot of duplicate **objects** For example, we have 369 instances of `group_14`, we have 369 instances of `group_10` etc etc, all parented under 369 instances of `instance_0` {[F14196210](https://archive.blender.org/developer/F14196210/image.png) size=full} So like I said, to investigate further, I would check the collada file for wrong usage OR check blender importer code (in `DocumentImporter::create_instance_node`) There is also the following comment (that is either outdated, or gives us a hint that 979b06f739 was not meant to be fully functional yet) ``` /* XXX instance_node is not supported yet */ ```

Philipp Oeser commented

2023-01-25 10:43:06 +01:00

12afa64de9 is related as well.
I would really check on the recursive nature of DocumentImporter::create_instance_node

12afa64de9 is related as well. I would really check on the recursive nature of `DocumentImporter::create_instance_node`

Sarah Smith commented

2023-02-08 00:00:37 +01:00

I would like to request a progress bar or information window that is shown during the importing of a model. I imported today a 90 MB Collada model (which successfully worked) but it took several minutes to import.

It would be useful to have some feedback to the user so we know the importing is still busy. I thought Blender crashed but it was not, because the importing took several minutes.

I would like to request a progress bar or information window that is shown during the importing of a model. I imported today a 90 MB Collada model (which successfully worked) but it took several minutes to import. It would be useful to have some feedback to the user so we know the importing is still busy. I thought Blender crashed but it was not, because the importing took several minutes.

Bastien Montagne commented

2023-02-08 16:56:51 +01:00

@blender.girl please do not diverge from topic, and do not use the tracker for feature requests, thanks.

Bastien Montagne added this to the Pipeline, Assets & IO project 2023-02-09 15:39:30 +01:00

Bastien Montagne modified the project from Pipeline, Assets & IO to Core

2023-02-09 15:42:54 +01:00

Bastien Montagne removed this from the Core project 2023-02-09 18:20:29 +01:00

Philipp Oeser removed the

Download

What's New

Blender Studio

Manual

Developers Blog

Documentation

Benchmark

Blender Conference

Development Fund

One-time Donations

Regression: Importing of collada model with instances became a LOT slower since 2.80 (practically freezing) #104108