Libraries Changes for Blender 3.2 #95206
Labels
No Label
Interest
Alembic
Interest
Animation & Rigging
Interest
Asset Browser
Interest
Asset Browser Project Overview
Interest
Audio
Interest
Automated Testing
Interest
Blender Asset Bundle
Interest
BlendFile
Interest
Collada
Interest
Compatibility
Interest
Compositing
Interest
Core
Interest
Cycles
Interest
Dependency Graph
Interest
Development Management
Interest
EEVEE
Interest
EEVEE & Viewport
Interest
Freestyle
Interest
Geometry Nodes
Interest
Grease Pencil
Interest
ID Management
Interest
Images & Movies
Interest
Import Export
Interest
Line Art
Interest
Masking
Interest
Metal
Interest
Modeling
Interest
Modifiers
Interest
Motion Tracking
Interest
Nodes & Physics
Interest
OpenGL
Interest
Overlay
Interest
Overrides
Interest
Performance
Interest
Physics
Interest
Pipeline, Assets & IO
Interest
Platforms, Builds & Tests
Interest
Python API
Interest
Render & Cycles
Interest
Render Pipeline
Interest
Sculpt, Paint & Texture
Interest
Text Editor
Interest
Translations
Interest
Triaging
Interest
Undo
Interest
USD
Interest
User Interface
Interest
UV Editing
Interest
VFX & Video
Interest
Video Sequencer
Interest
Virtual Reality
Interest
Vulkan
Interest
Wayland
Interest
Workbench
Interest: X11
Legacy
Blender 2.8 Project
Legacy
Milestone 1: Basic, Local Asset Browser
Legacy
OpenGL Error
Meta
Good First Issue
Meta
Papercut
Meta
Retrospective
Meta
Security
Module
Animation & Rigging
Module
Core
Module
Development Management
Module
EEVEE & Viewport
Module
Grease Pencil
Module
Modeling
Module
Nodes & Physics
Module
Pipeline, Assets & IO
Module
Platforms, Builds & Tests
Module
Python API
Module
Render & Cycles
Module
Sculpt, Paint & Texture
Module
Triaging
Module
User Interface
Module
VFX & Video
Platform
FreeBSD
Platform
Linux
Platform
macOS
Platform
Windows
Priority
High
Priority
Low
Priority
Normal
Priority
Unbreak Now!
Status
Archived
Status
Confirmed
Status
Duplicate
Status
Needs Info from Developers
Status
Needs Information from User
Status
Needs Triage
Status
Resolved
Type
Bug
Type
Design
Type
Known Issue
Type
Patch
Type
Report
Type
To Do
No Milestone
No project
No Assignees
14 Participants
Notifications
Due Date
No due date set.
Dependencies
No dependencies set.
Reference: blender/blender#95206
Loading…
Reference in New Issue
No description provided.
Delete Branch "%!s(<nil>)"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
Here is the list of all expected changes to our libraries for the Blender 3.2 release.
Summary
Preliminary Libraries
shaderc (Preliminary: libs are requested for development by the EEVEE/Viewport team)
install_depsscriptlevel-zero1.7.15 (Preliminary: for D14480)
UpdateNot done, too late now, this will not be required by 3.2 anyway.install_depsscriptNew Libraries
webp 1.2.2
install_depsscriptd55a64a4faPyString 1.1.3
install_depsscriptd55a64a4faIMath 3.1.4
install_depsscriptf2455c7939fmt 8.0.0
UpdateHandled automatically by OIIO building scriptinstall_depsscriptUpdateHandled automatically by OIIO building scriptinstall_depsscriptUpdated Libraries
zlib 1.2.12
UpdateWe use system packages for this library.install_depsscriptffmpeg 5.0
UpdateNot done, too late now...install_depsscriptSDL 2.0.20 - Windows needs this, previous version will not build with vs2019
UpdateWe use system packages for this library.install_depsscriptOpenXR 1.0.22
install_depsscript D13950: Deps: upgrade OpenXR 1.0.17 -> 1.0.22Freetype 2.11.1 - Note, this one is also on the 3.1 ticket, this checklist here is*ONLY// tracking the trunk/master work.
b2e43a4a9dUpdateWe use system packages for this library.install_depsscriptlibjpeg-turbo 2.1.3
UpdateWe use system packages for this library.install_depsscriptBoost 1.78.0
install_depsscript3d5085375fBlosc 1.21.1
install_depsscript59681a7ccdOpenEXR 3.1.4
install_depsscriptf2455c7939install_depsscript1de051a7a9install_depsscript1de051a7a9install_depsscriptce5428b294.install_depsscriptce5428b294.UpdateWe use system packages for this library.install_depsscriptinstall_depsscriptcf31c4ba18TBB 2020U3
install_depsscript3d5085375fOpenVDB 9.0.0
install_depsscript59681a7ccd,db918ae9a4OGG 1.3.5
UpdateWe use system packages for this library.install_depsscriptVorbis 1.3.7
UpdateWe use system packages for this library.install_depsscriptFlac 1.3.4
UpdateWe use system packages for this library.install_depsscriptVPX 1.11.0
UpdateWe use system packages for this library.install_depsscriptx264 35fe20d1ba49918ec739a5b068c208ca82f977f7
UpdateWe use system packages for this library.install_depsscriptUpdateWe use system packages for this library.install_depsscriptUpdateNot handled currently.install_depsscriptEmbree 3.13.3
install_depsscript8bec875586.USD 22.03 (updated with fix from D14928)
install_depsscript75a9830d84.OIDN 1.4.3
install_depsscript8bec875586.ISPC 1.17.0
install_depsscript8bec875586.FFTW 3.3.10
UpdateWe use system packages for this library.install_depsscriptOpenAL 2.21.1
UpdateWe use system packages for this library.install_depsscriptautopep8 (+ pycodestyle and toml dependencies)
d2a01bb7cb)UpdateNot covered.install_depsscriptChanged status from 'Needs Triage' to: 'Confirmed'
Added subscriber: @LazyDodo
Added subscriber: @brecht
While we are no longer tracking the VFX platform, for 3.2 we should still upgrade to newer libraries for bug fixes and potentially improved performance and compatibility.
I suggest we upgrade to the latest stable versions of all these:
This issue was referenced by
84f30ac3a2Added subscribers: @ZedDB, @dr.sybren
sounds good to me, i have an updated oiio scripted already for a crasher we had (oiio #3259) was just waiting on a new release with said fix which came out last week.
however... USD was held up previously since it may have required some reintegration work and @dr.sybren just didn't have time for that in previous release cycle, building the latest ffmpeg 5: not super difficult from the perspective of the platform module, however there's significant work to be done on the blender side to make that work (according to @ZedDB)
I'd like to formally move to a system where modules request updates to the deps they are stakeholders of on their own schedule rather than forcing work upon them by updating deps out of the blue and perhaps against their will.
I was wrong actually. I have posted my initial work here: D14063
What is left to be done is to discuss some older code that I stumbled upon that should probably be cleaned up.
still work had to be done, the point is, i'd rather have you ask for an ffmpeg update than just drop one on you when you may be pinched for time already.
Just to prevent double work, i have most of the deps listed by brecht done, will push a branch likely this weekend, since last time the 3 of us in a single phab diff wasn't super great.
Added subscriber: @makowalski
temp branch is
tmp_lib_update_32with the following updatesnoteworthy changes:
boost_build_options.cmakeoutstanding issues:
image mapping uvtile oslbut haven't taken a closer look yet, could just be outdated test files{F12864470,width=50%}
Added subscriber: @deadpin
OSL failing test: I've been wanting to ask the OIIO folks (that's what's used to sample the texture) about why UDIM clamping is either under-spec'd or under-documented. The OSL behavior is different than base Cycles on all the clipping modes when tiles are present right now. We can change the test in the meantime to not inadvertently test clipping behavior. I have not asked them yet because I wanted to give them as clean as possible, pure OIIO, repro but I haven't managed to do it.
OIDN updates: If this is updated, I'd still like to see it built with
OIDN_FILTER_RTLIGHTMAP=OFFto save 7mb on the final blender.exe binary size. This setting determines if the "lightmap" weights are included which blender does not use.Added subscriber: @ankitm
A bit late but OpenAL (mac) can also be revisited..
4fb67ae809The libdir one causes link error.OIDN_FILTER_RTLIGHTMAP=OFFis fine indeed, we don't have any plans to start using that.I added a bunch of changes to the branch for macOS, which should also help on Linux:
* Use upstream Embree for Arm now that it includes required changes
* Fix various build issues with different TBB cmake option names
* Fix for renamed USD static lib
* Disable NanoVDB command line tools
* FindOpenEXR updated to find new lib names and separate Imath. Add it all
I merged master into the branch with the following message:
Added subscribers: @fclem, @EAW
Hey @fclem, in
9505af72d4I noticed you stated:While a Vulkan version does exist as
VK_NV_fragment_shader_barycentric, this is in addition to theNV_fragment_shader_barycentricOpenGL extension.This NVIDIA extension was added to GLEW v2.2.0 which was released in 2021.
Here is the link to log file if you want to check (*the log link on the Github README page takes you to an out of date Sourceforge page that still has v2.1.0 as the latest version//.)
While I have no idea how helpful this particular extension would be, it does point out that Blender is using GLEW version 1.13.0 which is from 2015. As you are currently working on the EEVEE update, would updating GLEW to a more recent version be helpful?
@EAW I am all for it! There might be a few other extensions that I can make use of :)
The copy blender uses by default is in
/externand is 2.0.0 (which you're free to update at your leisure, just run it through the bots before landing) , the 1.13.0 copy in svn is only used for cycles standalone, which is perfectly fine with a version that oldThat reminds me, OpenSubdiv stopped using GLEW in favor of its own OpenGL extension loading. So we should remove those variables from
opensubdiv.cmake. In fact afterc5dcfb6I think we could build OpenSubdiv without any GPU evaluator at all, and drop glfw, cuew and clew.At least I expect that it will make most sense to add use own GPU abstraction for Vulkan/Metal rather than rely on OpenSubdiv.
When bumping to OpenVDB 9, we should also apply this patch to remove the use of a deprecated function:
The new function is supposed to be a drop in replacement that has better performance and can handle more data types.
added fftw and openal since it was the last of the direct deps that did not receive a bump , also bumped oiio to one that came out a few days ago, since ... why not...
Think this should conclude the current update run.
Added subscriber: @Blendify
@LazyDodo I am interested in getting D1598 to master, could we add webp libs?
they are already scripted ever since the D1598 days just disabled, when D1598 is getting close to landing libs will be made for it.
If we are going to land D1598 for this release, I wouldn't mind enabling it in the branch so we don't have to build and commit OpenImageIO a second time.
I thought D1598 was close to landing 7 years ago when i scripted webp, so I'm a little cautious here, but if you think it'll make it ill enable it by default and bump to the latest version.
Unrelated side note/future development target, historically we had both oiio and imbuf reading files since oiio wasn't able to read from memory (only disk) with many (but not all i think) formats now supporting a memory proxy in recent OIIO perhaps time to revisit this?
Added subscriber: @satishgoda1
tmp_lib_update_32has been updated with webp library build support and some blender side fixes so it atleast links on windows, there's a blender linktime ordering issue on linux i didn't immediately saw a fix for.. but atleast the libs should build on linux.Added subscriber: @SteffenD
Added subscriber: @Emi_Martinez
For the OSL failing test mentioned sometime back
I added this test last release and it ends up testing 3 separate things: 's + OSL + clamp/wrap settings. It was modeled after the existing test that's already present but that one does not use OSL. It turns out that the OSL clamping behavior is already different than base Cycles for tiled textures since 2.8x etc. And now it's even more different with the new libs to break the test. I haven't had the opportunity to investigate further still.
In the meantime, I'm proposing to update the SVN .blend to not test the clamping/wrap settings by simply scaling in the UVs (confirmed working):
@brecht If this is ok, I'll check that change in so it won't cause issues for folks testing the libs.
@deadpin, thanks, please go ahead and commit that change.
This issue was referenced by
b9c37608a9This issue was referenced by
604c33e694This issue was referenced by None@62886
This issue was referenced by None@62887
This issue was referenced by None@62891
This issue was referenced by None@62892
Added subscriber: @TheRedWaxPolice
Added subscriber: @mont29
we did some poor book keeping in ffmpeg and zlib, both were updated, but we did not track them in this ticket until now, i added them so @mont29 at least gets a notification things have changed there
This issue was referenced by
f4827d08bcThis issue was referenced by
018acc5688Changed status from 'Confirmed' to: 'Resolved'
@LazyDodo missed your poke unfortunately, so ffmpeg for 3.2 with remain unchanged with
install_deps... not a big deal anyway I think. Zlib version is not really covert by the script, it just uses the available distro package.Think this can be closed now.