SM
Software Mansion•6mo ago
tintin

Does Overlay plugin support 30 fps?

I'm interesting in using Membrane Overlay Plugin to do real-time video processing. However, after reading this discussion, the maintainer mentioned that Image library is not suitable for real-time frame processing (I assume this meant 30 fps because it is taking ~40ms per frame. 
Full encode: 43ms

    Convert to YUV: 4.3ms
    3 x write to binary (each plane: 10.8 x 3 = 32.4ms
    So far 36.7ms (unaccounted for 7ms)

![reference](https://github.com/elixir-image/image/discussions/121#discussioncomment-8074166)
Full encode: 43ms

    Convert to YUV: 4.3ms
    3 x write to binary (each plane: 10.8 x 3 = 32.4ms
    So far 36.7ms (unaccounted for 7ms)

![reference](https://github.com/elixir-image/image/discussions/121#discussioncomment-8074166)
My input is 30 fps and I would like to overlay images then encode it to H264 for live stream. Is there any workaround so I can achieve 30fps? Could this plugin (https://github.com/membraneframework/membrane_live_compositor_plugin) work?
3 Replies
mat_hek
mat_hek•6mo ago
Hi @tintin , you should easily get 30 FPS on a full HD stream on a reasonable machine, because the plugin converts the overlay to YUV and works in the YUV domain instead of converting the video to RGB and back 😉
tintin
tintinOP•6mo ago
Thank you!
Wojciech_Barczynski
Wojciech_Barczynski•6mo ago
You can use membrane_live_compositor_plugin for that. However, if you want only static overlay on one stream, Membrane Overlay Plugin is probably a better choice (less dependencies, no need for IPC etc.).

Did you find this page helpful?