Issue was caused by the fact, that sequencer is working in sRGB space, but when there's only image input strips we need to make sure conversion from byte to float buffer would keep float buffer in sRGB space and wouldn't make it linear as it's supposed to be in other areas.