Software Mansion•4mo ago

Does Overlay plugin support 30 fps?

I'm interesting in using Membrane Overlay Plugin to do real-time video processing. However, after reading this discussion, the maintainer mentioned that Image library is not suitable for real-time frame processing (I assume this meant 30 fps because it is taking ~40ms per frame.

Full encode: 43ms

    Convert to YUV: 4.3ms
    3 x write to binary (each plane: 10.8 x 3 = 32.4ms
    So far 36.7ms (unaccounted for 7ms)

![reference](https://github.com/elixir-image/image/discussions/121#discussioncomment-8074166)

Full encode: 43ms

    Convert to YUV: 4.3ms
    3 x write to binary (each plane: 10.8 x 3 = 32.4ms
    So far 36.7ms (unaccounted for 7ms)

![reference](https://github.com/elixir-image/image/discussions/121#discussioncomment-8074166)

My input is 30 fps and I would like to overlay images then encode it to H264 for live stream. Is there any workaround so I can achieve 30fps? Could this plugin (https://github.com/membraneframework/membrane_live_compositor_plugin) work?

3 Replies

mat_hek•4mo ago

Hi @tintin , you should easily get 30 FPS on a full HD stream on a reasonable machine, because the plugin converts the overlay to YUV and works in the YUV domain instead of converting the video to RGB and back 😉

tintin•4mo ago

Thank you!

Wojciech_Barczynski•4mo ago

You can use membrane_live_compositor_plugin for that. However, if you want only static overlay on one stream, Membrane Overlay Plugin is probably a better choice (less dependencies, no need for IPC etc.).

Gaming

Programming

Does Overlay plugin support 30 fps?