Libraries Changes for Blender 3.2 #95206

Here is the list of all expected changes to our libraries for the Blender 3.2 release.

Summary

dep	old	new	notes
libjpeg-turbo	2.0.4	2.1.3
boost	1.73.0	1.78.0
blosc	1.5.0	1.21.1
OpenEXR	2.5.5	3.1.4
IMath	N/A	3.1.3	new dep seperated from OpenEXR
Alembic	1.7.16	1.8.3
OpenSubDiv	3.4.3	3.4.4
SDL	2.0.12	2.0.20	Needed for windows compiler bump to 2019
OpenColorIO	2.0.0	2.1.1
OpenImageIO	2.2.15.1	2.3.13.0
Tiff	4.1.0	4.3.0
fmt		8.0.0	new - build time dep for oiio
RobinMap		0.6.2	new - build time dep for oiio
OSL	1.11.14.1	1.11.17.0
TBB	2020U2	2020U3
OpenVDB	8.0.1	9.0.0
OGG	1.3.4	1.3.5
Vorbis	1.3.6	1.3.7
Flac	1.3.3	1.3.4
VPX	1.8.2	1.11.0
x264	33f9e1474613f593	35fe20d1ba49918e	semantic versioning is not a thing for them
OpenJpeg	2.3.1	2.4.0
PyString		1.1.3	new - build time dep for ocio
Expat	2.2.10	2.4.4
Embree	3.10.0	3.13.3
USD	21.02	22.03
OIDN	1.4.1	1.4.3
Ispc	1.16.0	1.17.0
fftw3	3.3.8	3.3.10
openal	1.20.1	1.21.1
webpl	n/a	1.2.2
zlib	1.2.11	1.2.12
level-zero	n/a	v1.7.15
ffmpeg	4.0	5.0

Preliminary Libraries

shaderc (Preliminary: libs are requested for development by the EEVEE/Viewport team)
- Update CMake deps builder D11678: depsbuilder: preliminary Vulkan/Shaderc build support.
- Add Package file to SVN
- Add precompiled libraries
  - Windows
  - Linux
  - macOS Intel
  - macOS Arm
- Update install_deps script
level-zero1.7.15 (Preliminary: for D14480)
- Update CMake deps builder
- Add Package file to SVN ({{rBL62874}}
- Add precompiled libraries
  - Windows ({rBL62864})
  - Linux ({rBL62892})
- ~~Update install_deps script~~ Not done, too late now, this will not be required by 3.2 anyway.

New Libraries

webp 1.2.2
- Update CMake deps builder
- Add Package file to SVN ({rBL62913}, {rBL62914})
- Add precompiled libraries
  - Windows({BL62897})
  - Linux ({rBL62892})
  - macOS Intel
  - macOS Arm
- Update install_deps script d55a64a4fa
PyString 1.1.3
- Update CMake deps builder
- Add Package file to SVN ({rBL62913}, {rBL62914})
- Add precompiled libraries
  - Windows({BL62897})
  - Linux ({rBL62892})
  - macOS Intel
  - macOS Arm
- Update install_deps script d55a64a4fa
IMath 3.1.4
- Update CMake deps builder
- Add Package file to SVN ({rBL62913}, {rBL62914})
- Add precompiled libraries
  - Windows({BL62897})
  - Linux ({rBL62892})
  - macOS Intel
  - macOS Arm
- Update install_deps script f2455c7939
fmt 8.0.0
- Update CMake deps builder
- Add Package file to SVN ({rBL62913}, {rBL62914})
- Add precompiled libraries
  - Windows - N/A - Build time dep for oiio only.
  - Linux N/A
  - macOS Intel N/A
  - macOS Arm N/A
- ~~Update install_deps script~~ Handled automatically by OIIO building script

RobinMap 0.6.2
- Update CMake deps builder
- Add Package file to SVN ({rBL62913}, {rBL62914})
- Add precompiled libraries
  - Windows - N/A - Build time dep for oiio only.
  - Linux
  - macOS Intel
  - macOS Arm
- ~~Update install_deps script~~ Handled automatically by OIIO building script

Updated Libraries

zlib 1.2.12
- Update CMake deps builder
- Add Package file to SVN ({rBL62913}, {rBL62914})
- Add precompiled libraries
  - Windows({BL62897})
  - Linux ({rBL62892})
  - macOS Intel
  - macOS Arm
- ~~Update install_deps script~~ We use system packages for this library.
ffmpeg 5.0
- Update CMake deps builder
- Add Package file to SVN ({rBL62913}, {rBL62914})
- Add precompiled libraries
  - Windows({BL62897})
  - Linux ({rBL62892})
  - macOS Intel
  - macOS Arm
- ~~Update install_deps script~~ Not done, too late now...
SDL 2.0.20 - Windows needs this, previous version will not build with vs2019
- Update CMake deps builder
- Add Package file to SVN ({rBL62913}, {rBL62914})
- Add precompiled libraries
  - Windows({BL62897})
  - Linux ({rBL62892})
  - macOS Intel
  - macOS Arm
- ~~Update install_deps script~~ We use system packages for this library.
OpenXR 1.0.22
- Update CMake deps builder D13950: Deps: upgrade OpenXR 1.0.17 -> 1.0.22
- Add Package file to SVN {rBL62839}
- Add precompiled libraries
  - Windows {rBL62838}
  - Linux {rBL62837}
  - macOS Intel N/A
  - macOS Arm N/A
- Update install_deps script D13950: Deps: upgrade OpenXR 1.0.17 -> 1.0.22
Freetype 2.11.1 - Note, this one is also on the 3.1 ticket, this checklist here is*ONLY// tracking the trunk/master work.
- Update CMake deps builder D13968: deps builder: Update freetype to 2.11.1 b2e43a4a9d
- Add Package {rBL62830}
- Add precompiled libraries
  - Windows {rBL62829}
  - Linux {rBL62825}
  - macOS {rBL62841}
  - macOS {rBL62841}
- ~~Update install_deps script~~ We use system packages for this library.
libjpeg-turbo 2.1.3
- Update CMake deps builder
- Add Package file to SVN ({rBL62913}, {rBL62914})
- Add precompiled libraries
  - Windows({BL62897})
  - Linux ({rBL62892})
  - macOS Intel
  - macOS Arm
- ~~Update install_deps script~~ We use system packages for this library.
Boost 1.78.0
- Update CMake deps builder
- Add Package file to SVN ({rBL62913}, {rBL62914})
- Add precompiled libraries
  - Windows({BL62897})
  - Linux ({rBL62892})
  - macOS Intel
  - macOS Arm
- Update install_deps script 3d5085375f
Blosc 1.21.1
- Update CMake deps builder
- Add Package file to SVN ({rBL62913}, {rBL62914})
- Add precompiled libraries
  - Windows({BL62897})
  - Linux ({rBL62892})
  - macOS Intel
  - macOS Arm
- Update install_deps script 59681a7ccd
OpenEXR 3.1.4
- Update CMake deps builder
- Add Package file to SVN ({rBL62913}, {rBL62914})
- Add precompiled libraries
  - Windows({BL62897})
  - Linux ({rBL62892})
  - macOS Intel
  - macOS Arm
- Update install_deps script f2455c7939

Alembic 1.8.3
- Update CMake deps builder
- Add Package file to SVN ({rBL62913}, {rBL62914})
- Add precompiled libraries
  - Windows({BL62897})
  - Linux ({rBL62892})
  - macOS Intel
  - macOS Arm
- Update install_deps script 1de051a7a9

OpenSubDiv 3.4.4 (updated to not use GLEW)
- Update CMake deps builder
- Add Package file to SVN ({rBL62913}, {rBL62914})
- Add precompiled libraries
  - Windows ({rBL62915}, {rBL62916} )
  - Linux ({rBL62892}, {rBL62917})
  - macOS Intel
  - macOS Arm
- Update install_deps script 1de051a7a9

OpenColorIO 2.1.1
- Update CMake deps builder
- Add Package file to SVN ({rBL62913}, {rBL62914})
- Add precompiled libraries
  - Windows({BL62897})
  - Linux ({rBL62892})
  - macOS Intel
  - macOS Arm
- Update install_deps script ce5428b294.

OpenImageIO 2.3.13.0
- Update CMake deps builder
- Add Package file to SVN ({rBL62913}, {rBL62914})
- Add precompiled libraries
  - Windows({BL62897})
  - Linux ({rBL62892})
  - macOS Intel
  - macOS Arm
- Update install_deps script ce5428b294.

Tiff 4.3.0
- Update CMake deps builder
- Add Package file to SVN ({rBL62913}, {rBL62914})
- Add precompiled libraries
  - Windows({BL62897})
  - Linux ({rBL62892})
  - macOS Intel
  - macOS Arm
- ~~Update install_deps script~~ We use system packages for this library.

OSL 1.11.17.0
- Update CMake deps builder
- Add Package file to SVN ({rBL62913}, {rBL62914})
- Add precompiled libraries
  - Windows({BL62897})
  - Linux ({rBL62892})
  - macOS Intel
  - macOS Arm
- Update install_deps script cf31c4ba18

TBB 2020U3
- Update CMake deps builder
- Add Package file to SVN ({rBL62913}, {rBL62914})
- Add precompiled libraries
  - Windows({BL62897})
  - Linux ({rBL62892})
  - macOS Intel
  - macOS Arm
- Update install_deps script 3d5085375f
OpenVDB 9.0.0
- Update CMake deps builder
- Add Package file to SVN ({rBL62913}, {rBL62914})
- Add precompiled libraries
  - Windows({BL62897})
  - Linux ({rBL62892} & {rBL62900})
  - macOS Intel
  - macOS Arm
- Update install_deps script 59681a7ccd, db918ae9a4
OGG 1.3.5
- Update CMake deps builder
- Add Package file to SVN ({rBL62913}, {rBL62914})
- Add precompiled libraries
  - Windows({BL62897})
  - Linux ({rBL62892})
  - macOS Intel
  - macOS Arm
- ~~Update install_deps script~~ We use system packages for this library.

Vorbis 1.3.7
- Update CMake deps builder
- Add Package file to SVN ({rBL62913}, {rBL62914})
- Add precompiled libraries
  - Windows({BL62897})
  - Linux ({rBL62892})
  - macOS Intel
  - macOS Arm
- ~~Update install_deps script~~ We use system packages for this library.
Flac 1.3.4
- Update CMake deps builder
- Add Package file to SVN ({rBL62913}, {rBL62914})
- Add precompiled libraries
  - Windows({BL62897})
  - Linux ({rBL62892})
  - macOS Intel
  - macOS Arm
- ~~Update install_deps script~~ We use system packages for this library.

VPX 1.11.0
- Update CMake deps builder
- Add Package file to SVN ({rBL62913}, {rBL62914})
- Add precompiled libraries
  - Windows({BL62897})
  - Linux ({rBL62892})
  - macOS Intel
  - macOS Arm
- ~~Update install_deps script~~ We use system packages for this library.
x264 35fe20d1ba49918ec739a5b068c208ca82f977f7
- Update CMake deps builder
- Add Package file to SVN ({rBL62913}, {rBL62914})
- Add precompiled libraries
  - Windows({BL62897})
  - Linux ({rBL62892})
  - macOS Intel
  - macOS Arm
- ~~Update install_deps script~~ We use system packages for this library.

OpenJpeg 2.4.0
- Update CMake deps builder
- Add Package file to SVN ({rBL62913}, {rBL62914})
- Add precompiled libraries
  - Windows({BL62897})
  - Linux ({rBL62892})
  - macOS Intel
  - macOS Arm
- ~~Update install_deps script~~ We use system packages for this library.

Expat 2.4.4
- Update CMake deps builder
- Add Package file to SVN ({rBL62913}, {rBL62914})
- Add precompiled libraries
  - Windows({BL62897})
  - Linux (build-time dep only)
  - macOS Intel
  - macOS Arm
- ~~Update install_deps script~~ Not handled currently.

Embree 3.13.3
- Update CMake deps builder
- Add Package file to SVN ({rBL62913}, {rBL62914})
- Add precompiled libraries
  - Windows({BL62897})
  - Linux ({rBL62892})
  - macOS Intel
  - macOS Arm
- Update install_deps script 8bec875586.
USD 22.03 (updated with fix from D14928)
- Update CMake deps builder
- Add Package file to SVN ({rBL62913}, {rBL62914})
- Add precompiled libraries
  - Windows ( {rBL62922}, {rBL62923} )
  - Linux ({rBL62892}, {rBL62905}, {rBL62926})
  - macOS Intel
  - macOS Arm
- Update install_deps script 75a9830d84.
OIDN 1.4.3
- Update CMake deps builder
- Add Package file to SVN ({rBL62913}, {rBL62914})
- Add precompiled libraries
  - Windows({BL62897})
  - Linux ({rBL62892})
  - macOS Intel
  - macOS Arm
- Update install_deps script 8bec875586.

ISPC 1.17.0
- Update CMake deps builder
- Add Package file to SVN ({rBL62913}, {rBL62914})
- Add precompiled libraries
  - Windows - N/A Build time dep for embree only.
  - Linux
  - macOS Intel
  - macOS Arm
- Update install_deps script 8bec875586.
FFTW 3.3.10
- Update CMake deps builder
- Add Package file to SVN ({rBL62913}, {rBL62914})
- Add precompiled libraries
  - Windows({BL62897})
  - Linux ({rBL62892})
  - macOS Intel
  - macOS Arm
- ~~Update install_deps script~~ We use system packages for this library.
OpenAL 2.21.1
- Update CMake deps builder
- Add Package file to SVN ({rBL62913}, {rBL62914})
- Add precompiled libraries
  - Windows({BL62897})
  - Linux ({rBL62892})
  - macOS Intel
  - macOS Arm
- ~~Update install_deps script~~ We use system packages for this library.
autopep8 (+ pycodestyle and toml dependencies)
- Update CMake deps builder (d2a01bb7cb)
- Add Package file to SVN ~NA~
- Add precompiled libraries
  - Windows({BL62897})
  - Linux ({rBL62892})
  - macOS Intel
  - macOS Arm
- ~~Update install_deps script~~ Not covered.

Changed status from 'Needs Triage' to: 'Confirmed'

Added subscriber: @LazyDodo

Added subscriber: @brecht

While we are no longer tracking the VFX platform, for 3.2 we should still upgrade to newer libraries for bug fixes and potentially improved performance and compatibility.

I suggest we upgrade to the latest stable versions of all these:

Alembic
Boost
Embree
OpenColorIO
OpenEXR
OpenImageIO
OpenSubdiv
OSL
OpenVDB (and remove NanoVDB as separate lib)
USD

This issue was referenced by 84f30ac3a2

Added subscribers: @ZedDB, @dr.sybren

While we are no longer tracking the VFX platform, for 3.2 we should still upgrade to newer libraries for bug fixes and potentially improved performance and compatibility.

sounds good to me, i have an updated oiio scripted already for a crasher we had (oiio #3259) was just waiting on a new release with said fix which came out last week.

however... USD was held up previously since it may have required some reintegration work and @dr.sybren just didn't have time for that in previous release cycle, building the latest ffmpeg 5: not super difficult from the perspective of the platform module, however there's significant work to be done on the blender side to make that work (according to @ZedDB)

I'd like to formally move to a system where modules request updates to the deps they are stakeholders of on their own schedule rather than forcing work upon them by updating deps out of the blue and perhaps against their will.

not super difficult from the perspective of the platform module, however there's significant work to be done on the blender side to make that work

I was wrong actually. I have posted my initial work here: D14063
What is left to be done is to discuss some older code that I stumbled upon that should probably be cleaned up.

still work had to be done, the point is, i'd rather have you ask for an ffmpeg update than just drop one on you when you may be pinched for time already.

Just to prevent double work, i have most of the deps listed by brecht done, will push a branch likely this weekend, since last time the 3 of us in a single phab diff wasn't super great.

Added subscriber: @makowalski

temp branch is tmp_lib_update_32 with the following updates

Dep	Version	Notes
Alembic	1.8.3	-
Boost	1.78	-
Embree	3.13.3	-
ispc	1.17.0	-
OpenColorIO	2.1.1	-
Pystring	1.1.3	new dep, I caught ocio downloading this, which compliance wise is not ok
OpenEXR	3.14	-
Imath	3.14	new lib, split off openEXR
OpenImageIO	2.3.12.0	-
OpenSubdiv	3.4.4	-
OSL	1.11.17.0	-
OpenVDB	9.0.0	nano vdb needs a closer look, should be in there, but i didn't see the headers
USD	21.11	Needs minor work on the blender side, i did the simpler search+replace changes, @makowalski is taking a look at the remaining issues
OpenJpeg	2.4.0	-
jpeg	2.1.2	-
TIFF	4.3.0	-
oidn	1.4.2	-

noteworthy changes:

The boost settings where duplicated over all files that used it, and i found my self making the same change over and over these settings have moved into boost_build_options.cmake
libjpeg build scripts inconsistent use of jpeg and jpg, I picked a team, and used jpeg everywhere now.
cleanup of lots of unused variables and things that have been renamed in the upstream packages.

outstanding issues:

Paperwork on top of this thread needs to be updated with checklists
Tested on windows only, normally i'd take a swing at at least making sure linux builds for me but didn't have the time.
nano-vdb support in openvdb 9.0.0
USD needs some reintegration work
I had a failing test on image mapping uvtile osl but haven't taken a closer look yet, could just be outdated test files

{F12864470,width=50%}

Added subscriber: @deadpin

OSL failing test: I've been wanting to ask the OIIO folks (that's what's used to sample the texture) about why UDIM clamping is either under-spec'd or under-documented. The OSL behavior is different than base Cycles on all the clipping modes when tiles are present right now. We can change the test in the meantime to not inadvertently test clipping behavior. I have not asked them yet because I wanted to give them as clean as possible, pure OIIO, repro but I haven't managed to do it.

OIDN updates: If this is updated, I'd still like to see it built with OIDN_FILTER_RTLIGHTMAP=OFF to save 7mb on the final blender.exe binary size. This setting determines if the "lightmap" weights are included which blender does not use.

Added subscriber: @ankitm

A bit late but OpenAL (mac) can also be revisited.. 4fb67ae809 The libdir one causes link error.

OIDN_FILTER_RTLIGHTMAP=OFF is fine indeed, we don't have any plans to start using that.

I added a bunch of changes to the branch for macOS, which should also help on Linux:
* Use upstream Embree for Arm now that it includes required changes
* Fix various build issues with different TBB cmake option names
* Fix for renamed USD static lib
* Disable NanoVDB command line tools
* FindOpenEXR updated to find new lib names and separate Imath. Add it all

    to the list of  OpenEXR include dirs and libs. This keeps things compatible
    with both version 2.x and 3.x for now.

* FindOpenImageIO updated to link to separate OpenImageIO_Util for new

    versions, where it is required.

* Link to GameController and CoreHaptics frameworker for latest SDL. This seems

    unnecessary though as we don't even use SDL joystick functionality. However
    disabling SDL joystick or haptics support gives link errors due to missing
    symbols, which would likely require patching SDL to solve.

I merged master into the branch with the following message:

Code and find module changes for OpenEXR and OpenImageIO are now in master and replace the changes in this branch. The WITH_IMATH build option was removed as Linux and macOS code only use WITH_IMAGE_OPENEXR and there is no immediate benefit to supporting this separation now.

Added subscribers: @fclem, @EAW

Hey @fclem, in 9505af72d4 I noticed you stated:

A geometry shader fallback is generated if the extension AMD_shader_explicit_vertex_parameter is not available.
NV_fragment_shader_barycentric was not considered because it is not present inside the glew.h (we) use and seems to only be available with vulkan.

While a Vulkan version does exist as VK_NV_fragment_shader_barycentric, this is in addition to the NV_fragment_shader_barycentric OpenGL extension.

This NVIDIA extension was added to GLEW v2.2.0 which was released in 2021.
Here is the link to log file if you want to check (*the log link on the Github README page takes you to an out of date Sourceforge page that still has v2.1.0 as the latest version//.)

While I have no idea how helpful this particular extension would be, it does point out that Blender is using GLEW version 1.13.0 which is from 2015. As you are currently working on the EEVEE update, would updating GLEW to a more recent version be helpful?

@EAW I am all for it! There might be a few other extensions that I can make use of :)

While I have no idea how helpful this particular extension would be, it does point out that Blender is using GLEW version 1.13.0 which is from 2015.

The copy blender uses by default is in /extern and is 2.0.0 (which you're free to update at your leisure, just run it through the bots before landing) , the 1.13.0 copy in svn is only used for cycles standalone, which is perfectly fine with a version that old

That reminds me, OpenSubdiv stopped using GLEW in favor of its own OpenGL extension loading. So we should remove those variables from opensubdiv.cmake. In fact after c5dcfb6 I think we could build OpenSubdiv without any GPU evaluator at all, and drop glfw, cuew and clew.

At least I expect that it will make most sense to add use own GPU abstraction for Vulkan/Metal rather than rely on OpenSubdiv.

When bumping to OpenVDB 9, we should also apply this patch to remove the use of a deprecated function:

diff --git a/intern/cycles/scene/volume.cpp b/intern/cycles/scene/volume.cpp
index 0555fdd2fad..820bcc0a9d2 100644
--- a/intern/cycles/scene/volume.cpp
+++ b/intern/cycles/scene/volume.cpp
@@ -258,7 +258,7 @@ void VolumeMeshBuilder::add_grid(openvdb::GridBase::ConstPtr grid,
 void VolumeMeshBuilder::add_padding(int pad_size)
 {
 #ifdef WITH_OPENVDB
-  openvdb::tools::dilateVoxels(topology_grid->tree(), pad_size);
+  openvdb::tools::dilateActiveValues(topology_grid->tree(), pad_size);
 #else
   (void)pad_size;
 #endif

The new function is supposed to be a drop in replacement that has better performance and can handle more data types.

added fftw and openal since it was the last of the direct deps that did not receive a bump , also bumped oiio to one that came out a few days ago, since ... why not...

Think this should conclude the current update run.

Added subscriber: @Blendify

@LazyDodo I am interested in getting D1598 to master, could we add webp libs?

they are already scripted ever since the D1598 days just disabled, when D1598 is getting close to landing libs will be made for it.

If we are going to land D1598 for this release, I wouldn't mind enabling it in the branch so we don't have to build and commit OpenImageIO a second time.

I thought D1598 was close to landing 7 years ago when i scripted webp, so I'm a little cautious here, but if you think it'll make it ill enable it by default and bump to the latest version.

Unrelated side note/future development target, historically we had both oiio and imbuf reading files since oiio wasn't able to read from memory (only disk) with many (but not all i think) formats now supporting a memory proxy in recent OIIO perhaps time to revisit this?

Added subscriber: @satishgoda1

tmp_lib_update_32 has been updated with webp library build support and some blender side fixes so it atleast links on windows, there's a blender linktime ordering issue on linux i didn't immediately saw a fix for.. but atleast the libs should build on linux.

Added subscriber: @SteffenD

Added subscriber: @Emi_Martinez

For the OSL failing test mentioned sometime back
I added this test last release and it ends up testing 3 separate things: 's + OSL + clamp/wrap settings. It was modeled after the existing test that's already present but that one does not use OSL. It turns out that the OSL clamping behavior is already different than base Cycles for tiled textures since 2.8x etc. And now it's even more different with the new libs to break the test. I haven't had the opportunity to investigate further still.

In the meantime, I'm proposing to update the SVN .blend to not test the clamping/wrap settings by simply scaling in the UVs (confirmed working):

before	proposed change

@brecht If this is ok, I'll check that change in so it won't cause issues for folks testing the libs.

@deadpin, thanks, please go ahead and commit that change.

This issue was referenced by b9c37608a9

This issue was referenced by 604c33e694

This issue was referenced by None@62886

This issue was referenced by None@62887

This issue was referenced by None@62891

This issue was referenced by None@62892

Added subscriber: @TheRedWaxPolice

Added subscriber: @mont29

we did some poor book keeping in ffmpeg and zlib, both were updated, but we did not track them in this ticket until now, i added them so @mont29 at least gets a notification things have changed there

This issue was referenced by f4827d08bc

This issue was referenced by 018acc5688

Changed status from 'Confirmed' to: 'Resolved'

@LazyDodo missed your poke unfortunately, so ffmpeg for 3.2 with remain unchanged with install_deps... not a big deal anyway I think. Zlib version is not really covert by the script, it just uses the available distro package.

Think this can be closed now.

Download

What's New

Blender Studio

Manual

Developers Blog

Documentation

Benchmark

Blender Conference

Development Fund

One-time Donations

Libraries Changes for Blender 3.2 #95206