Billal
Billal
PostsComments
SMSoftware Mansion
Created by ℓé on 1/21/2025 in #membrane-help
Get Video from RTSP and stream by RTMP
Looking at your pipeline now, I noticed that you're using RTSP to read from a local webcam, it'll not work since the webcam don't use rtsp protocol. I tried a test with my webcam (only video) with the following code and it works fine 
defmodule Pipeline do
  use Membrane.Pipeline

  def handle_init(_ctx, _opts) do
    spec = [
      child(:camera, %Membrane.CameraCapture{device: "/dev/video1"})
      |> child(:converter, %Membrane.FFmpeg.SWScale.Converter{format: :I420})
      |> child(:overlay, %Membrane.OverlayFilter{
        initial_overlay: %Membrane.OverlayFilter.OverlayDescription{
          overlay: "/path/to/logo.png", 
          x: :right, 
          y: :top
        }
      })
      |> child(:video_encoder, %Membrane.H264.FFmpeg.Encoder{
        profile: :baseline, 
        preset: :ultrafast, 
        tune: :zerolatency
      })
      |> child(:video_payloader, %Membrane.H264.Parser{
        output_stream_structure: :avc1, 
        }
      )
      |> via_in(Pad.ref(:video, 0))
      |> child(:sink, %Membrane.RTMP.Sink{
        rtmp_url: "rtmp://127.0.0.1:1935/live",
        tracks: [:video],
        max_attempts: 10
      })
    ]

    {[spec: spec], %{}}
  end
end
defmodule Pipeline do
  use Membrane.Pipeline

  def handle_init(_ctx, _opts) do
    spec = [
      child(:camera, %Membrane.CameraCapture{device: "/dev/video1"})
      |> child(:converter, %Membrane.FFmpeg.SWScale.Converter{format: :I420})
      |> child(:overlay, %Membrane.OverlayFilter{
        initial_overlay: %Membrane.OverlayFilter.OverlayDescription{
          overlay: "/path/to/logo.png", 
          x: :right, 
          y: :top
        }
      })
      |> child(:video_encoder, %Membrane.H264.FFmpeg.Encoder{
        profile: :baseline, 
        preset: :ultrafast, 
        tune: :zerolatency
      })
      |> child(:video_payloader, %Membrane.H264.Parser{
        output_stream_structure: :avc1, 
        }
      )
      |> via_in(Pad.ref(:video, 0))
      |> child(:sink, %Membrane.RTMP.Sink{
        rtmp_url: "rtmp://127.0.0.1:1935/live",
        tracks: [:video],
        max_attempts: 10
      })
    ]

    {[spec: spec], %{}}
  end
end
9 replies
SMSoftware Mansion
Created by oleg.okunevych on 1/24/2025 in #membrane-help
RTSP push approach with Membrane.RTSP.Server
Most probably the issue is that parameter sets are not in the stream. You should check the SDP sent by ffmpeg to the rtsp server, get the parameters sets and send them to the parser with repeat parameter sets set to true. 
|> child(:depayloader, Membrane.RTP.H264.Depayloader)
    |> child(:rtsp_video_parser, %Membrane.H264.Parser{
      generate_best_effort_timestamps: %{framerate: {25, 1}},
      output_stream_structure: :annexb,
      spss: spss,
      ppss: ppss,
      repeat_parameter_sets: true
    })
    |> via_in(:input,
      options: [encoding: :H264, segment_duration: Membrane.Time.seconds(4)]
    )
    |> child(:hls, %Membrane.HTTPAdaptiveStream.SinkBin{
      target_window_duration: Membrane.Time.seconds(120),
      manifest_module: Membrane.HTTPAdaptiveStream.HLS,
      storage: %Membrane.HTTPAdaptiveStream.Storages.FileStorage{
        directory: "/tmp/"
      }
    })
|> child(:depayloader, Membrane.RTP.H264.Depayloader)
    |> child(:rtsp_video_parser, %Membrane.H264.Parser{
      generate_best_effort_timestamps: %{framerate: {25, 1}},
      output_stream_structure: :annexb,
      spss: spss,
      ppss: ppss,
      repeat_parameter_sets: true
    })
    |> via_in(:input,
      options: [encoding: :H264, segment_duration: Membrane.Time.seconds(4)]
    )
    |> child(:hls, %Membrane.HTTPAdaptiveStream.SinkBin{
      target_window_duration: Membrane.Time.seconds(120),
      manifest_module: Membrane.HTTPAdaptiveStream.HLS,
      storage: %Membrane.HTTPAdaptiveStream.Storages.FileStorage{
        directory: "/tmp/"
      }
    })
Again fetch the sps and pps from the SDP
12 replies
SMSoftware Mansion
Created by oleg.okunevych on 1/24/2025 in #membrane-help
RTSP push approach with Membrane.RTSP.Server
If you fixed the first issue, now to the second one, most probably erlang is dropping packets because of the internal buffer. Set the buffer and recbuf to some bigger value: options = [ :binary, active: false, reuseaddr: true, debug: false, buffer: 500_000, recbuf: 500_000 ] increase the value if packets are still dropped. In the doc, it says that you should watch recbuf set by the kernel and ajust buffer to be >= that value, however from my own tests I'm still observing dropped packets, so i set both values.
12 replies
SMSoftware Mansion
Created by oleg.okunevych on 1/24/2025 in #membrane-help
RTSP push approach with Membrane.RTSP.Server
Is your packets ordered, since you're using UDP, the packets may arrive out of order so you need first to re-order them before depayloading
12 replies
SMSoftware Mansion
Created by ℓé on 1/21/2025 in #membrane-help
Get Video from RTSP and stream by RTMP
Share your code in github or somewhere else to review it
9 replies
SMSoftware Mansion
Created by ℓé on 1/21/2025 in #membrane-help
Get Video from RTSP and stream by RTMP
The issue is that you link Membrane.RTSP.Source pads directly to other elements which is not how the plugin works. You have to wait for notification from the rtsp source before linking to other elements. Check the documentation for an example: https://hexdocs.pm/membrane_rtsp_plugin/readme.html#usage And by the way the RTSP video output will be encoded access units, so you cannot feed it directly to a pixel converter, you need first to decode it. and the decoder output will be :I420 images most of the time so you don't need the converter only the decoder.
9 replies
SMSoftware Mansion
Created by Aske on 7/4/2024 in #membrane-help
H265 choppy playback in QuickTime on Mac
Once I finish with my use case, I'll try to adapt it for usage with the membrane plugin.
14 replies
SMSoftware Mansion
Created by Aske on 7/4/2024 in #membrane-help
H265 choppy playback in QuickTime on Mac
I'll try to create a PR in membrane_mp4_plugin to fix this issue. Yes you can use ex_mp4 to write a muxer however membrane_mp4_plugin is more appropriate for your use case.
14 replies
SMSoftware Mansion
Created by Aske on 7/4/2024 in #membrane-help
H265 choppy playback in QuickTime on Mac
Yes, it is. I wanted something to manipulate mp4 files without using pipelines.
14 replies
SMSoftware Mansion
Created by Aske on 7/4/2024 in #membrane-help
H265 choppy playback in QuickTime on Mac
Hi @Aske Most probably the reason is the missing ctts (composition offset table) from the muxed MP4 (membrane muxer doesn't store this table). I processed the input file with an updated version of membrane_mp4_plugin, I don't have a MAC, so you can try the file on your side.
14 replies