Problem dewarping nvarguscamerasrc with nvdewarp on xavier

Hi guys,

I am trying to create gstreamer pipeline to run nvdewarper plugin from Deep Stream 4 on live stream from nvarguscamerasrc, but I fail to configure it and I can’t find example in the docs.

My question is does the nvdewarp plugin from Deep Stream 4 work with nvarguscamerasrc?

Pipeline:

nvarguscamerasrc ! "video/x-raw(memory:NVMM)" ! nvvidconv ! "video/x-raw(memory:NVMM), format=(string)RGBA" ! nvdewarper config-file=dewarp_config.txt source-id=6 ! m.sink_0 nvstreammux name=m
width=1945 height=1109 batch-size=1 num-surfaces-per-frame=1 ! nvvidconv ! nvegltransform ! nveglglessink

dewarp_config.txt:

[surface0]
# 1=PushBroom, 2=VertRadCyl
projection-type=1
surface-index=0
#dewarped surface parameters
width=1945
height=1109
top-angle=25
bottom-angle=-25
pitch=2
yaw=0
roll=0
focal-length=1198

On Xavier board with Leopard Imagine IMX264 camera

Output from gstreamer:

Using winsys: x11 
Pipeline is live and does not need PREROLL ...
Got context from element 'eglglessink0': gst.egl.EGLDisplay=context, display=(GstEGLDisplay)NULL;
Setting pipeline to PLAYING ...
New clock: GstSystemClock
in videoconvert caps = video/x-raw(memory:NVMM), format=(string)RGBA, framerate=(fraction)30/1, width=(int)960, height=(int)752
GST_ARGUS: Creating output stream
CONSUMER: Waiting until producer is connected...
GST_ARGUS: Available Sensor modes :
GST_ARGUS: 1948 x 1096 FR = 59,999999 fps Duration = 16666667 ; Analog Gain range min 1,000000, max 31,000000; Exposure Range min 14000, max 16650000;

GST_ARGUS: Running with following settings:
   Camera index = 0 
   Camera mode  = 0 
   Output Stream W = 1948 H = 1096 
   seconds to Run    = 0 
   Frame Rate = 59,999999 
GST_ARGUS: PowerService: requested_clock_Hz=27216000
GST_ARGUS: Setup Complete, Starting captures for 0 seconds
GST_ARGUS: Starting repeat capture requests.
CONSUMER: Producer has connected; continuing.
Caught SIGSEGV
#0  0x0000007f7b920048 in __GI___poll (fds=0x55a6ffb600, nfds=547535114864, timeout=<optimized out>) at ../sysdeps/unix/sysv/linux/poll.c:41
#1  0x0000007f7ba2ce40 in  () at /usr/lib/aarch64-linux-gnu/libglib-2.0.so.0
#2  0x00000055a62a9b10 in  ()
Spinning.  Please run 'gdb gst-launch-1.0 22510' to continue debugging, Ctrl-C to quit, or Ctrl-\ to dump core.

Hi,
Please refer to the sample:

deepstream_sdk_v4.0_jetson\sources\apps\sample_apps\deepstream-dewarper-test

You may customize it by replacing video decoding source with nvarguscamerasrc

Hi, yes that’s exactly what I did. I took the example and tried to replace the video source to be nvarguscamerasrc.

Hi,
sample_cam6.mp4 is in 1472x1384. You may scale your nvarguscamerasrc to this resolution and try again.

Or generate a mp4, replace sample_cam6.mp4 and give it a try.

$ gst-launch-1.0 nvarguscamerasrc num-buffers=30 bufapi-version=1 ! 'video/x-raw(memory:NVMM),width=1920,height=1080,format=NV12,framerate=2/1' ! nvvideoconvert ! 'video/x-raw(memory:NVMM)' ! nvv4l2h264enc ! h264parse ! qtmux ! filesink location=a.mp4