Blender / Cycles / Material list Crash - When dealing with image sequences longer than 63 images long on Windows #50616

New Issue

Carlo Andreacchio · 2017-02-08T00:55:59+01:00

Carlo Andreacchio commented

2017-02-08 00:55:59 +01:00

Edited to refine the crash problem

System Information
Windows 7 x64 GTX 1080, core i7 920

Blender Version
Broken: 411836d through to f7eaaf3
Worked: e9689e1

Short description of error
Image sequences part of a material which have more then 63 images in the folder crashes out blender on windows

animatedBillboard.zip
Extract zip file, open materialListCrash3.blend, go into the material tab, and list materials

Video of the crash -- 2017-02-11 12-38-14.zip

Doesnt matter if JPG or PNG images. both will cause a crash
if you delete one image out from the animatedBillboard folder, it will work fine.

Extra tests, all give out crashes.
Removing all system prefs
Factory settings
Server machine, raw win7 install with only blender drivers installed
Multiple artist machines.

Edited to refine the crash problem **System Information** Windows 7 x64 GTX 1080, core i7 920 **Blender Version** Broken: 411836d through to f7eaaf3 Worked: e9689e1 **Short description of error** Image sequences part of a material which have more then 63 images in the folder crashes out blender on windows [animatedBillboard.zip](https://archive.blender.org/developer/F482957/animatedBillboard.zip) Extract zip file, open materialListCrash3.blend, go into the material tab, and list materials Video of the crash -- [2017-02-11 12-38-14.zip](https://archive.blender.org/developer/F482988/2017-02-11_12-38-14.zip) Doesnt matter if JPG or PNG images. both will cause a crash if you delete one image out from the animatedBillboard folder, it will work fine. Extra tests, all give out crashes. Removing all system prefs Factory settings Server machine, raw win7 install with only blender drivers installed Multiple artist machines.

Carlo Andreacchio commented

2017-02-08 00:55:59 +01:00

Changed status to: 'Open'

Carlo Andreacchio commented

2017-02-08 00:55:59 +01:00

Added subscriber: @candreacchio

Carlo Andreacchio commented

2017-02-08 01:23:12 +01:00

Deleting the next shader in the blend file (not by name) via python ( bpy.data.materials[60].user_clear() ) fixed the crash... However, importing the offending shader into a new blend file seemed not crash that blender out. The offending material was only two nodes, a diffuse shader and a output node.

Doing some more tests now.

EDIT: Didnt fix the crash :(, i think there are two lots of crashes going on rather than just one. Both to do with the material icon generation.

Deleting the next shader in the blend file (not by name) via python ( bpy.data.materials[60].user_clear() ) fixed the crash... However, importing the offending shader into a new blend file seemed not crash that blender out. The offending material was only two nodes, a diffuse shader and a output node. Doing some more tests now. EDIT: Didnt fix the crash :(, i think there are two lots of crashes going on rather than just one. Both to do with the material icon generation.

Joey Ferwerda commented

2017-02-09 16:11:25 +01:00

Added subscriber: @TheOnlyJoey

Joey Ferwerda commented

2017-02-09 16:11:25 +01:00

These things are difficult to test without a test scene.
Can you reproduce the case on a simpler scene?

Also what is the amount of RAM in your system?

These things are difficult to test without a test scene. Can you reproduce the case on a simpler scene? Also what is the amount of RAM in your system?

Carlo Andreacchio commented

2017-02-09 22:11:12 +01:00

This is one of the crashes. Managed to simplify it down to one material. But I cant seem to replicate it totally, as when the link is totally broken it doesnt crash.

Removing the animated image seems to fix the crash. The file path is correct and pointing to a valid image, if i view the image in the image editor first then load up the material list it seems to work fine.

materialListCrash.blend

This is a windows computer with network drives mapped to the Z / Y / X locations.

RAM is fine, 16gb on the host, 8gb on the gpu

This is one of the crashes. Managed to simplify it down to one material. But I cant seem to replicate it totally, as when the link is totally broken it doesnt crash. Removing the animated image seems to fix the crash. The file path is correct and pointing to a valid image, if i view the image in the image editor first then load up the material list it seems to work fine. [materialListCrash.blend](https://archive.blender.org/developer/F479903/materialListCrash.blend) This is a windows computer with network drives mapped to the Z / Y / X locations. RAM is fine, 16gb on the host, 8gb on the gpu

Carlo Andreacchio commented

2017-02-09 22:19:40 +01:00

Second crash was also from an animated texture. This one was relatively referenced instead of absolutely. Not sure if that makes a difference

Carlo Andreacchio commented

2017-02-09 22:29:20 +01:00

Ok so deleting those two materials out of the scene does fix the material list crashing.

There seems to be a problem with loading up animated image textures.

Could be because we are looping the textures, or loading them up off a slightly latent device (network disks).

Ok so deleting those two materials out of the scene does fix the material list crashing. There seems to be a problem with loading up animated image textures. Could be because we are looping the textures, or loading them up off a slightly latent device (network disks).

Bastien Montagne commented

2017-02-10 10:50:21 +01:00

Added subscriber: @mont29

Bastien Montagne commented

2017-02-10 10:50:21 +01:00

No crash here, but then, do not have the images… can you please embed the crashing sequence in the .blend?

Carlo Andreacchio commented

2017-02-10 11:06:08 +01:00

The images are not the problem but more how they are loaded up.

It is a PNG image sequence, and probably wont be able to provide either of them. one had an alpha channel one did not

Loading up the image file directly in the UV/Image editor first allowed it to work correctly.

I will try and replicate the issue tomorrow.

The images are not the problem but more how they are loaded up. It is a PNG image sequence, and probably wont be able to provide either of them. one had an alpha channel one did not Loading up the image file directly in the UV/Image editor first allowed it to work correctly. I will try and replicate the issue tomorrow.

Carlo Andreacchio commented

2017-02-10 12:02:14 +01:00

I have tried to replicate on linux and unable.. will try windows tomorrow.

Carlo Andreacchio commented

2017-02-11 01:31:24 +01:00

Managed to replicate under windows. Has to do with image sequences larger then 63 images long

Doesnt matter if JPG or PNG images. both will cause a crash

Extract zip file, open materialListCrash3.blend, go into the material tab, and list materials

animatedBillboard.zip

if you delete one image out from the animatedBillboard folder, it will work fine.

Managed to replicate under windows. Has to do with image sequences larger then 63 images long Doesnt matter if JPG or PNG images. both will cause a crash Extract zip file, open materialListCrash3.blend, go into the material tab, and list materials [animatedBillboard.zip](https://archive.blender.org/developer/F482957/animatedBillboard.zip) if you delete one image out from the animatedBillboard folder, it will work fine.

Carlo Andreacchio changed title from ~~Blender / Cycles / Material list Crash~~ to Blender / Cycles / Material list Crash - When dealing with image sequences longer than 63 images long on Windows

2017-02-11 01:33:33 +01:00

Ray molenkamp commented

2017-02-11 02:50:33 +01:00

Added subscriber: @LazyDodo

Ray molenkamp commented

2017-02-11 02:50:33 +01:00

blender 2017-02-10 18-47-02-074.mp4 With latest buildbot ( 38155c7 ) win64 , did i miss anything?

edit: not sure why but video won't play, here's a youtube link https://youtu.be/qUmuNPJmERA

[blender 2017-02-10 18-47-02-074.mp4](https://archive.blender.org/developer/F482982/blender_2017-02-10_18-47-02-074.mp4) With latest buildbot ( 38155c7 ) win64 , did i miss anything? edit: not sure why but video won't play, here's a youtube link https://youtu.be/qUmuNPJmERA

Carlo Andreacchio commented

2017-02-11 02:57:18 +01:00

yeh i just downloaded it manually and watched.

So my system crashes out at around the 5 second mark when it is generating the icon for the material list.

Are you running windows 7? maybe it is a OS issue?

yeh i just downloaded it manually and watched. So my system crashes out at around the 5 second mark when it is generating the icon for the material list. Are you running windows 7? maybe it is a OS issue?

Ray molenkamp commented

2017-02-11 02:58:34 +01:00

i am running win7

Carlo Andreacchio commented

2017-02-11 03:04:30 +01:00

ill download a screen recorder.....

Carlo Andreacchio commented

2017-02-11 03:09:47 +01:00

2017-02-11 12-38-14.zip

If i delete one file out of that folder it doesnt crash

[2017-02-11 12-38-14.zip](https://archive.blender.org/developer/F482988/2017-02-11_12-38-14.zip) If i delete one file out of that folder it doesnt crash

Carlo Andreacchio commented

2017-02-11 03:13:09 +01:00

system info txt file here -- system-info.txt

Tried clearing my user prefs and that didnt fix it either.

system info txt file here -- [system-info.txt](https://archive.blender.org/developer/F482991/system-info.txt) Tried clearing my user prefs and that didnt fix it either.

Ray molenkamp commented

2017-02-11 03:19:18 +01:00

try running "blender.exe --factory-startup"

Carlo Andreacchio commented

2017-02-11 03:21:14 +01:00

In #50616#416846, @LazyDodo wrote:
try running "blender.exe --factory-startup"

Crash

> In #50616#416846, @LazyDodo wrote: > try running "blender.exe --factory-startup" Crash

Carlo Andreacchio commented

2017-02-11 03:24:28 +01:00

Could be because of this commit? b047d79 -- https://lists.blender.org/pipermail/bf-blender-cvs/2016-November/091529.html, fits into the right timeline.

We dont build our own blenders, otherwise I would help out finding the exact commit.

Could be because of this commit? b047d79 -- https://lists.blender.org/pipermail/bf-blender-cvs/2016-November/091529.html, fits into the right timeline. We dont build our own blenders, otherwise I would help out finding the exact commit.

Ray molenkamp commented

2017-02-11 03:28:45 +01:00

Could be anything really, but unless we can reproduce the issue it'll be very hard to point a finger at something.

Carlo Andreacchio commented

2017-02-11 03:38:44 +01:00

I just tried it on one of our server machines running the stock windows 7 (no upgrades, nothing else installed apart from blender / drivers / windows 7 (no sp1)), crash on that aswell.

core i7 860 gtx 1080.

I just tried it on one of our server machines running the stock windows 7 (no upgrades, nothing else installed apart from blender / drivers / windows 7 (no sp1)), crash on that aswell. core i7 860 gtx 1080.

Ray molenkamp commented

2017-02-11 05:25:07 +01:00

Yup was able to repro it on a clean win7 VM, but not with a debug build, so feels like a race condition somewhere

Bastien Montagne commented

2017-02-11 16:19:45 +01:00

Can you try to start Blender with -t 1 option (from command line), and see if crash still happens? This should disable multi-threading, and tell us whether it’s a causing the problem or not.

Can you try to start Blender with `-t 1` option (from command line), and see if crash still happens? This should disable multi-threading, and tell us whether it’s a causing the problem or not.

Ray molenkamp commented

2017-02-11 17:11:53 +01:00

t 1 doesen't help , but i was able to grab a stack trace

 	blender.exe!memcpy() Line 128	Unknown
 	0000000000000004()	Unknown
 	00000000000e1000()	Unknown
>	blender.exe!ccl::BlenderSession::builtin_image_pixels(const std::basic_string<char,std::char_traits<char>,std::allocator<char> > & builtin_name, void * builtin_data, unsigned char * pixels, const unsigned __int64 pixels_size) Line 1170	C++

 	blender.exe!ccl::ImageManager::file_load_image<2,unsigned char,unsigned char>(ccl::ImageManager::Image * img, ccl::ImageManager::ImageDataType type, int texture_limit, ccl::device_vector<unsigned char> & tex_img) Line 552	C++
 	blender.exe!ccl::ImageManager::device_load_image(ccl::Device * device, ccl::DeviceScene * dscene, ccl::Scene * scene, ccl::ImageManager::ImageDataType type, int slot, ccl::Progress * progress) Line 761	C++
 	[External Code]	
 	blender.exe!ccl::TaskPool::wait_work(ccl::TaskPool::Summary * stats) Line 98	C++
 	blender.exe!ccl::ImageManager::device_update(ccl::Device * device, ccl::DeviceScene * dscene, ccl::Scene * scene, ccl::Progress & progress) Line 946	C++
 	blender.exe!ccl::Scene::device_update(ccl::Device * device_, ccl::Progress & progress) Line 192	C++
 	blender.exe!ccl::Session::update_scene() Line 818	C++
 	blender.exe!ccl::Session::run_cpu() Line 546	C++
 	blender.exe!ccl::Session::run() Line 690	C++
 	blender.exe!ccl::thread::run(void * arg) Line 57	C++
 	pthreadVC2.dll!000007fee771627b()	Unknown
 	pthreadVC2.dll!000007fee7718eb7()	Unknown
 	pthreadVC2.dll!000007fee7719102()	Unknown
 	[External Code]

- t 1 doesen't help , but i was able to grab a stack trace ``` blender.exe!memcpy() Line 128 Unknown 0000000000000004() Unknown 00000000000e1000() Unknown > blender.exe!ccl::BlenderSession::builtin_image_pixels(const std::basic_string<char,std::char_traits<char>,std::allocator<char> > & builtin_name, void * builtin_data, unsigned char * pixels, const unsigned __int64 pixels_size) Line 1170 C++ blender.exe!ccl::ImageManager::file_load_image<2,unsigned char,unsigned char>(ccl::ImageManager::Image * img, ccl::ImageManager::ImageDataType type, int texture_limit, ccl::device_vector<unsigned char> & tex_img) Line 552 C++ blender.exe!ccl::ImageManager::device_load_image(ccl::Device * device, ccl::DeviceScene * dscene, ccl::Scene * scene, ccl::ImageManager::ImageDataType type, int slot, ccl::Progress * progress) Line 761 C++ [External Code] blender.exe!ccl::TaskPool::wait_work(ccl::TaskPool::Summary * stats) Line 98 C++ blender.exe!ccl::ImageManager::device_update(ccl::Device * device, ccl::DeviceScene * dscene, ccl::Scene * scene, ccl::Progress & progress) Line 946 C++ blender.exe!ccl::Scene::device_update(ccl::Device * device_, ccl::Progress & progress) Line 192 C++ blender.exe!ccl::Session::update_scene() Line 818 C++ blender.exe!ccl::Session::run_cpu() Line 546 C++ blender.exe!ccl::Session::run() Line 690 C++ blender.exe!ccl::thread::run(void * arg) Line 57 C++ pthreadVC2.dll!000007fee771627b() Unknown pthreadVC2.dll!000007fee7718eb7() Unknown pthreadVC2.dll!000007fee7719102() Unknown [External Code] ```

Ray molenkamp commented

2017-02-11 17:29:14 +01:00

Added subscriber: @Sergey

Ray molenkamp commented

2017-02-11 17:29:14 +01:00

it does seem to come from the b047d79 change, @Sergey mind taking a peek?

it does seem to come from the b047d79 change, @Sergey mind taking a peek?

Ray molenkamp commented

2017-02-11 18:47:59 +01:00

https://git.blender.org/gitweb/gitweb.cgi/blender.git/blob/HEAD:/intern/cycles/render/image.cpp#l505

allocates a buffer 1280(w)*720(h)*1(d) but

https://git.blender.org/gitweb/gitweb.cgi/blender.git/blob/HEAD:/intern/cycles/render/image.cpp#l549

copies num_pixels(whd) * components (4) bytes of data neatly overflowing the buffer with 4 times as much data as it can take.

https://git.blender.org/gitweb/gitweb.cgi/blender.git/blob/HEAD:/intern/cycles/render/image.cpp#l505 allocates a buffer 1280(w)*720(h)*1(d) but https://git.blender.org/gitweb/gitweb.cgi/blender.git/blob/HEAD:/intern/cycles/render/image.cpp#l549 copies num_pixels(w*h*d) * components (4) bytes of data neatly overflowing the buffer with 4 times as much data as it can take.

Sergey Sharybin commented

2017-02-12 10:43:21 +01:00

Changed status from 'Open' to: 'Resolved'

Sergey Sharybin closed this issue

2017-02-12 10:43:21 +01:00

Sergey Sharybin self-assigned this 2017-02-12 10:43:21 +01:00

Sergey Sharybin commented

2017-02-12 10:43:21 +01:00

Crash should be fixed now. Thanks for the report.

Sign in to join this conversation.

No Label

Download

What's New

Blender Studio

Manual

Developers Blog

Documentation

Benchmark

Blender Conference

Development Fund

One-time Donations

Blender / Cycles / Material list Crash - When dealing with image sequences longer than 63 images long on Windows #50616