WIP: Video: 10/12 BPP and HDR video output support #120033

Aras Pranckevicius · 2024-03-28T20:41:51+01:00

2024-03-28 20:41:51 +01:00

WIP!

I don't think this works "actually correctly" yet; but also the OCIO config does not have the required HLG bits yet, so I'm trying to emulate that manually. And possibly I got something wrong. Also the whole settings thing, not sure if that is the right place and way of doing it.

Anyway, what is here now is:

Video section got "bits/pixel" setting. Defaults to 8, which was the only option before. Now also shows 10 and 12 bpp options.
- TODO: Have to somehow limit it to only display what is supported by the codec (and the ffmpeg build, which might be custom!). E.g. H264 should show (8, 10) options with default ffmpeg build, whereas AV1 should show (8, 10, 12).
Video section got "HDR" setting. Currently this is either "None" or "Rec.2020 HLG".

The settings are independent, and it is a good question whether they should be. I opted for independent ones, since e.g. this would allow 10bpp videos even for non-HDR use cases (which can improve smooth gradients). In theory you can also use HDR with 8bpp videos (but really you should not, since banding will be quite severe) -- should the UI "somehow" try to prevent that?

Behavior:

When HDR video output is requested, the scene Linear colorspace gets hardcoded to Linear Rec.2020. The UI shows non-HDR color space options (since it thinks that "ffmpeg" image type is "not HDR", ugh). These are completely ignored!
For HDR input, the input Linear Rec.2020 values get manually transformed into HLG before passing that into ffmpeg. This ideally should be done by OCIO, but we don't have the config yet.
More than 8bpp incoming image for ffmpeg encoding gets translated into proper format for swscale (input packed RGBA floats -> planar R,G,B,A floats -> YUV formats with 10 or 12 bpp).

WIP! ![](/attachments/168820d2-f102-426b-bb97-ca4a4142a92f) I don't think this works "actually correctly" yet; but also the OCIO config does not have the required HLG bits yet, so I'm trying to emulate that manually. And possibly I got something wrong. Also the whole settings thing, not sure if that is the right place and way of doing it. Anyway, what is here now is: - Video section got "bits/pixel" setting. Defaults to 8, which was the only option before. Now also shows 10 and 12 bpp options. - TODO: Have to somehow limit it to only display what is supported by the codec (and the ffmpeg build, which might be custom!). E.g. H264 should show (8, 10) options with default ffmpeg build, whereas AV1 should show (8, 10, 12). - Video section got "HDR" setting. Currently this is either "None" or "Rec.2020 HLG". The settings are independent, and it is a good question whether they should be. I opted for independent ones, since e.g. this would allow 10bpp videos even for non-HDR use cases (which can improve smooth gradients). In theory you can also use HDR with 8bpp videos (but really you should not, since banding will be quite severe) -- should the UI "somehow" try to prevent that? Behavior: - When HDR video output is requested, the scene Linear colorspace gets hardcoded to `Linear Rec.2020`. The UI shows non-HDR color space options (since it thinks that "ffmpeg" image type is "not HDR", ugh). These are completely ignored! - For HDR input, the input `Linear Rec.2020` values get manually transformed into HLG before passing that into ffmpeg. This ideally should be done by OCIO, but we don't have the config yet. - More than 8bpp incoming image for ffmpeg encoding gets translated into proper format for swscale (input packed RGBA floats -> planar R,G,B,A floats -> YUV formats with 10 or 12 bpp).

video_options.png

16 KiB

🚀 2

Aras Pranckevicius added 2 commits 2024-03-28 20:42:01 +01:00

df22461490 Video: add video_bpp and video_hdr enum settings to FFMpegCodecData

6fbbbdc490 Video: initial code to support >8bpp and/or HDR (HLG) video output

Aras Pranckevicius added this to the Video Sequencer project 2024-04-09 10:32:05 +02:00

Aras Pranckevicius added 1 commit 2024-04-12 19:23:24 +02:00

1cf58feaf8 Merge branch 'main' into ffmpeg_hdr

# Conflicts:
#	source/blender/blenkernel/intern/writeffmpeg.cc

Aras Pranckevicius added 1 commit 2024-04-12 19:27:57 +02:00

35db26e7be Fix build after main merge

Aras Pranckevicius added 1 commit 2024-04-22 09:28:37 +02:00

ed131f47ad Merge branch 'main' into ffmpeg_hdr

This pull request is marked as a work in progress.

View command line instructions.

Checkout

From your project repository, check out a new branch and test the changes.

git fetch -u ffmpeg_hdr:aras_p-ffmpeg_hdr

git checkout aras_p-ffmpeg_hdr

Sign in to join this conversation.

No reviewers

No Label

Download

What's New

Blender Studio

Manual

Developers Blog

Documentation

Benchmark

Blender Conference

Development Fund

One-time Donations

WIP: Video: 10/12 BPP and HDR video output support #120033

Checkout