BlenderVSE: Seeking/Scrubbing issue #100495
Labels
No Label
Interest
Alembic
Interest
Animation & Rigging
Interest
Asset Browser
Interest
Asset Browser Project Overview
Interest
Audio
Interest
Automated Testing
Interest
Blender Asset Bundle
Interest
BlendFile
Interest
Collada
Interest
Compatibility
Interest
Compositing
Interest
Core
Interest
Cycles
Interest
Dependency Graph
Interest
Development Management
Interest
EEVEE
Interest
EEVEE & Viewport
Interest
Freestyle
Interest
Geometry Nodes
Interest
Grease Pencil
Interest
ID Management
Interest
Images & Movies
Interest
Import Export
Interest
Line Art
Interest
Masking
Interest
Metal
Interest
Modeling
Interest
Modifiers
Interest
Motion Tracking
Interest
Nodes & Physics
Interest
OpenGL
Interest
Overlay
Interest
Overrides
Interest
Performance
Interest
Physics
Interest
Pipeline, Assets & IO
Interest
Platforms, Builds & Tests
Interest
Python API
Interest
Render & Cycles
Interest
Render Pipeline
Interest
Sculpt, Paint & Texture
Interest
Text Editor
Interest
Translations
Interest
Triaging
Interest
Undo
Interest
USD
Interest
User Interface
Interest
UV Editing
Interest
VFX & Video
Interest
Video Sequencer
Interest
Virtual Reality
Interest
Vulkan
Interest
Wayland
Interest
Workbench
Interest: X11
Legacy
Blender 2.8 Project
Legacy
Milestone 1: Basic, Local Asset Browser
Legacy
OpenGL Error
Meta
Good First Issue
Meta
Papercut
Meta
Retrospective
Meta
Security
Module
Animation & Rigging
Module
Core
Module
Development Management
Module
EEVEE & Viewport
Module
Grease Pencil
Module
Modeling
Module
Nodes & Physics
Module
Pipeline, Assets & IO
Module
Platforms, Builds & Tests
Module
Python API
Module
Render & Cycles
Module
Sculpt, Paint & Texture
Module
Triaging
Module
User Interface
Module
VFX & Video
Platform
FreeBSD
Platform
Linux
Platform
macOS
Platform
Windows
Priority
High
Priority
Low
Priority
Normal
Priority
Unbreak Now!
Status
Archived
Status
Confirmed
Status
Duplicate
Status
Needs Info from Developers
Status
Needs Information from User
Status
Needs Triage
Status
Resolved
Type
Bug
Type
Design
Type
Known Issue
Type
Patch
Type
Report
Type
To Do
No Milestone
No project
No Assignees
3 Participants
Notifications
Due Date
No due date set.
Dependencies
No dependencies set.
Reference: blender/blender#100495
Loading…
Reference in New Issue
No description provided.
Delete Branch "%!s(<nil>)"
Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?
{F13403727}BasicEditingBug_Take2_ExaminingCuts.mp4
{F13403412}System Information
Operating system: Windows 10
Graphics card: Intel UHD Graphics 620
Other System Tested: Ubuntu 20.04, Nvidia RTX 3070
Blender Version
Broken: current release 3.2.2 and blender-3.4.0-alpha+master.2a2ca3292a93-linux.x86_64-release
Worked: I don't know
Note: Problem is much worse in 3.2.2, in 3.4 alpha it is better if you use refresh often.
When scrubing/searching the video frames get "shuffled around" leading to frames that are off/displaced, freeze frames, jumping frames etc. Doing exact cuts is not possible anymore.
Exact steps for others to reproduce the error
Watch my attached screencasts first (captured on windwos 10, 3.2.2). The longer video shows the steps to reproduce. The shorter video shows me examining the resulting cuts. All cuts are wrongly placed. At second 0:23 you see that frames are shuffled around between two scenes (even after a refresh)
The large video file is the sample file to work with when reproducing the bug. It was edited and rendered using VSE 2 years ago.
Instructions:
Another way to see if the preview is off/messed up is by rendering a video of the portion you worked on. Overlay it with transparency and see if everything aligns. Frames will be off.
Added subscriber: @Michael-47
Added subscriber: @iss
Can you also upload .blend file?
I am mainly interested in state of proxy settings:
If you can't upload .blend file, please upload screenshot.
Changed status from 'Needs Triage' to: 'Needs User Info'
Changed status from 'Needs User Info' to: 'Confirmed'
@Michael-47 I was able to reproduce the issue, just quickly looking at debug output, seeking is definitely way off with this file. I am not sure why yet.
You have mentioned, that this is video rendered with Blender - is this original file you have stored on HDD or is it downloaded from some service like Youtube? Some(most?) of these services do re-encode original files to save up storage space and may do some tricks to optimize seeking perhaps. but I think they should still be playable.
So far I can only suggest workaround - build proxies and set them up as I have above in screenshot.
here you go! a messed up file. only split cuts no editing done to it. all i did was performing the described steps from my bugreport.
to reproduce this bug i loaded factory settings!
When trying to work around this bug i tried everything i could think of. Proxies, No Proxies, Prefetch Frames, etc. No solution
SeekingIssueSampleFile.blend
Its the original render output from blender VSE. As render settings i use the preset provided by the power sequencer addon (Youtube Render Preset)
Now checking with proxies, and there are indeed glitches, so that is no good.
Haven't done any deep dive so far, but I have checked this file with 3 versions of ffplay (ffmpeg internal player) and with VLC, both failed and missed a lot of video frames when seeking to random positions. Looking at youtube preset of power sequencer now and I am pretty sure I have used nearly same settings 2 years ago too. Never saw problem like this though.
Further looking at metadata of provided file, they does not seem to come from Blender and audio bitrate does not match mentioned preset either:
For this case I would transcode provided file with command
ffmpeg.exe -i bad_file.mp4 -c:v libx264 -crf 16 -g 10 fixed.mp4
.Do you remember on which OS this video was rendered? I am thinking, that it could have been rendered with Blender distributed through OS packaging system which could explain VLC encoder, but even this would be unlikely scenario I would say...
the video was rendered with blender on windows 10. i usually use the render preset from power sequencer and i am pretty sure it was the case for this video as well. I found the 2year old projectfile. Here is a screenshot of the render settings:
one more thing: the first problems I had where with mp4 files from my camera. the problem is a little different but maybe it is related. I found rendered videos to show slightly different frames to the preview when importing the render result back into blender and overlaying it with 50% transparency. here is what i saw:
two frames that clearly are not the same and even a image render showed this (screenshot shows render image not preview!). however a video render of the original video and the renderresult overlayed with transparency did not show these ghostframes/difference.
Can you upload the original project file? I would like to reproduce this issue and fix encoder settings if this still happens. I need the file, because it should contain blender version it was last saved with, unless you re-saved file in newer one.
When movie is rendered, even if content is not correct, it must not affect integrity of rendered file. This seems to be caused by weird encoder settings somehow. Still this VLC encoder puzzles me though. I know, that Power Sequencer addon had feature, that can speed up rendering by splitting file into chunks and then joining them. Do you remember if you used this feature? maybe it is automatically used without asking, should look into that as well.
sorry if this is leading away from the orignal bug. i feel like it is related.
here is a broken file showing problems described above, with files straight from my camera (not rendered from blender). what you see is a clip of the original file overlayed by the render result with 50% transparency. When rendering this again what you get is the third clip on top. The third clip does not show ghostframes but the preview does and render image also does show a difference. frame 530 (21+05) is a good example. Along with the broke file comes the render output and the render output that i would have expect to show ghostframes/blury frames and the original file (4k from canon camera).
MVI_7312.MP4
lastSyncTest01.blend
lastSyncTest01_rendering01_blury.mp4
lastSyncTest01_rendering01.mp4
these are two blendfiles i used to render the EasyRobot_Final.mp4 file. two because sometimes i save a new version after render. VideoSchnittTemplate24.blend
VideoSchnittTemplate25.blend
the power sequencer setting to render chunks is nothing I am aware of. If its a default i might have used it.
Thanks for files.
Since it was saved with version 2.82, I have tried to render sample by adding own material to timeline. However even if I render with version 2.82, I get very different metadata:
Mainly
encoder: Lavf58.12.100
is what I would expect here, since this is what we supplied Blender 2.82 with.Looked into power sequencer and it does not implement multithreaded rendering - it is standalone script only so this is not a factor here.
So far it looks to me, that the provided video got corrupted somehow. Are you able to re-render the video with Blender 2.82? At least a portion of it?
If the video is comming from different device/software It should be reported in new report. I will have a look at it, but it will likely be completely different cause of the seemingly same issue.
Also looking at file, it was saved with 3.2 version, but seeking improvements have been implemented in 3.3 version, so check with latest alpha - I was not able to reproduce any issues.
The video file I uploaded was somewhat chosen by random. I just tried another file from 3 month later and one from 6 month before (not sure with blender version was used but i use most recent usually). They all have issues in 3.2. Current alpha is much better but i still felt like the preview glitches after a few split cuts. And after a refresh I also found cuts being off by a frame or two. Regarding this information what should do next? Regarding your question: I think I could rerender the file from the bugreport but as mentioned I do not feel its just this file.
I reproduced this with current alpha. The .blend is attached. Use MVI_7312.mp4 to reproduce. I still think it is the same problem (preview glitching when seeking/scrubbing) and just another way to visualize it. This method is better to see slight glitches.
Alpha_CameraMP4Test.blend
My current understanding of this problem is, that file you have provided is broken, and I am 90% confident, it has either not been rendered with Blender or has been re-encoded at some point. I don't have any reason to not believe you, that it has been rendered by Blender though, which is why I want you to try to render it again and see if new file would behave normally (I am quite confident it would). If it won't help, I would probably want to see smaller chunk (250 frames or so) of render, to examine it's metadata. Then if I would see same metadata as in original file I would probably request Blender binary you have used and summon other developers to explain to me how it is possible that it uses encoder we do not supply in official distributions.
If you are willing to re-render the video, you can download previous versions of Blender here: https://download.blender.org/release/Blender2.82/
We have implemenmted a fair bit of workarounds for seeking issues which unfortunately come in many forms. You would see that frame is off and refresh mostly works, but this is mostly true for all sorts of causes.
In any case I don't have file
Alpha_CameraMP4Test.mp4
, I assume I have to render it from fileMVI_7312.MP4
, is that correct? I did that and did not see any problem.Better way to check for errors is color mix effect strip with difference mode and then multiply colors to better see tiny details
So if original strip and render are aligned here is difference:
no_offset.mp4
Without colors being multiplied, you would see almost nothing, and what you see is pretty much loss of quality due to encoder optimizing the image. Perceptually lossless is not quite lossless.
Here I intentionally misaligned strips so there is 1-frame offset:
1_frame_offset.mp4
It would be quite obvious if any frame is misalligned
also here is my .blend file for reference:
#100495.blend
When looking into the working files I saw that for this specific project I used blender to render the picture and audio separately. Making some post production to the audio and then putting picture and audio together using VLC Mediaplayer. I did this only for this one project and forgot about it. I am Sorry! (If you want I still can upload the rerender)
Thanks for investigating. Looking at your video files leaves me asking if this is a render output? I have problems with the preview. I use this overlaying method to find frames where the preview of the edited original (buttom layer) is different to the upper layer (render result). If I find one I refresh and see if it helps, often it doesn't. Rendering the composition of the two layers as video however does not show a difference, which suggests to me that the preview is off. Here is a screenshot of the preview + render result (right after refreshing, using currrent alpha version)
Sorry for forgetting to upload the neccesairy files. Here they are: Alpha_CameraMP4Test_blury.mp4 Alpha_CameraMP4Test.mp4
Thanks for info. In this case you can report a bug to VLC if it's still reproducible. You said, that you have other broken files so I can have a look at them, but best would be to create new report for that. For example the file from your camera I would need to clarify steps to reproduce, because I can't replicate any issue there.
Just a tip: when Blender fails to seek to exact timestamp, it emits a red log line where it says something like "scan unhappy". To see it you have to run Blender with
--debug-ffmpeg
argument. The logs are quite noisy, but the red line usually pops up and it is easy to spot.So if you can include a log like this
I would know where to look for bad frames (
cur_pts=85738
tells me the position)Ok, taking a step back from this. I reported a bug because I had problems with glitches in the Preview with different files. I chose a file that was most problematic/easy to reproduce. It turned out to be broken or at least not straight from blender. But I experience problems with other files, too. Its better in the alpha (when refreshing often). Now I do not know, should I investigate more into other video files or is it a known issue that the preview is not perfect?
I just file another bug report #100672. I did not include the file from the camera because it is 2gb and re-uploading it takes forever. In the quoted comment above I tried to further explain what I experience (preview glitsches, not differences in rendered result). Maybe you want to look at it again.
Changed status from 'Confirmed' to: 'Archived'
Sorry for delay, and thanks for new report, will check it out. This one I will close since other media players have trouble processing it too.