Jetpack3.2.1, TX2 CSI-MIPI can only get the the first frame of image, but TX1 works fine.

Hello Everyone:
We have a problem with TX2CSI MIPI, as described below:

Description:
1.We have a self-designed board which compatible with tx1 and tx2, the board use FPGA to create fix mipi signal(1920x1080,yuv422,15fps) feed to the csi port of tx1 or tx2.
2.We have written the driver and dtsi according to the Driver Package Documentation: ‘Sensor Driver Programming Guide’, and the /dev/videoX is ready for use.The driver files of tx1,tx2 are the same.
3.We use command:“gst-launch-1.0 v4l2src device=”/dev/video1" ! “video/x-raw, width=1920,height=1080, format=(string)I420” ! xvimagesink -e" to test the board
4.With JetPack3.0 the tx1 works fine
5.With Jetpack3.2.1,we can only get the first frame correctly, but by setting chan->timeout=200, tx1 still works fine.
6.With Jetpack3.2.1,we can only get the first frame correctly, setting chan->timeout=200 is without use.
6.1 we have tried the 3rd part v4l2 tool, when capture the second frame VIDIOC_DQBUF: failed: Input/output error occurs:
Question:
1. we use the format of YUV422. Are those mclk_khz, pix_clk_hz and mclk_multiplier useful in mode nodes?
2. Cound you give us some clue to debug this ?

trace_log:
root@tegra-ubuntu:/home/nvidia/work# cat /sys/kernel/debug/tracing/trace
# tracer: nop
#
# entries-in-buffer/entries-written: 23/23 #P:4
#
# _-----=> irqs-off
# / _----=> need-resched
# | / _—=> hardirq/softirq
# || / _–=> preempt-depth
# ||| / delay
# TASK-PID CPU# |||| TIMESTAMP FUNCTION
# | | | |||| | |
kworker/4:2-268 [004] …1 406.651008: rtos_queue_peek_from_isr_failed: tstamp:13039109912 queue:0x0b4a3c58
kworker/4:2-268 [004] …1 406.651011: rtcpu_start: tstamp:13039110897
kworker/4:2-268 [004] …1 406.760276: rtcpu_vinotify_handle_msg: tstamp:13042527919 tag:CSIMUX_STREAM channel:0xff frame:0 vi_tstamp:157625603 data:0x00010000
kworker/4:2-268 [004] …1 406.760279: rtcpu_vinotify_handle_msg: tstamp:13043388038 tag:CHANSEL_PXL_SOF channel:0x00 frame:1 vi_tstamp:158485599 data:0x00000001
kworker/4:2-268 [004] …1 406.760280: rtcpu_vinotify_handle_msg: tstamp:13043388200 tag:ATOMP_FS channel:0x00 frame:1 vi_tstamp:158485612 data:0x00000000
kworker/4:2-268 [004] …1 406.760282: rtos_queue_peek_from_isr_failed: tstamp:13044110807 queue:0x0b4a3c58
kworker/4:2-268 [004] …1 406.812304: rtcpu_vinotify_handle_msg: tstamp:13044587580 tag:CHANSEL_PXL_EOF channel:0x00 frame:1 vi_tstamp:159685285 data:0x04370002
kworker/4:2-268 [004] …1 406.812307: rtcpu_vinotify_handle_msg: tstamp:13044637750 tag:CSIMUX_FRAME channel:0x00 frame:1 vi_tstamp:159735285 data:0x000000a4
kworker/4:2-268 [004] …1 406.812308: rtcpu_vinotify_handle_msg: tstamp:13044637942 tag:ATOMP_FE channel:0x00 frame:1 vi_tstamp:159735289 data:0x00000000
kworker/4:2-268 [004] …1 406.932301: rtos_queue_peek_from_isr_failed: tstamp:13049111309 queue:0x0b4a3c58
kworker/4:2-268 [004] …1 407.088336: rtos_queue_peek_from_isr_failed: tstamp:13054111818 queue:0x0b4a3c58
kworker/4:2-268 [004] …1 407.244333: rtos_queue_peek_from_isr_failed: tstamp:13059112298 queue:0x0b4a3c58
kworker/4:2-268 [004] …1 407.400336: rtos_queue_peek_from_isr_failed: tstamp:13064112848 queue:0x0b4a3c58
kworker/4:2-268 [004] …1 407.608329: rtos_queue_peek_from_isr_failed: tstamp:13069113323 queue:0x0b4a3c58
kworker/4:2-268 [004] …1 407.764320: rtos_queue_peek_from_isr_failed: tstamp:13074113832 queue:0x0b4a3c58
kworker/4:2-268 [004] …1 407.928408: rtos_queue_peek_from_isr_failed: tstamp:13079114615 queue:0x0b4a3c58
kworker/4:2-268 [004] …1 408.084602: rtos_queue_peek_from_isr_failed: tstamp:13084115103 queue:0x0b4a3c58
kworker/4:2-268 [004] …1 408.240353: rtos_queue_peek_from_isr_failed: tstamp:13089116018 queue:0x0b4a3c58
kworker/4:2-268 [004] …1 408.396319: rtos_queue_peek_from_isr_failed: tstamp:13094115892 queue:0x0b4a3c58
kworker/4:2-268 [004] …1 408.552343: rtos_queue_peek_from_isr_failed: tstamp:13099116362 queue:0x0b4a3c58
kworker/4:2-268 [004] …1 408.708323: rtos_queue_peek_from_isr_failed: tstamp:13104116863 queue:0x0b4a3c58
kworker/4:2-268 [004] …1 408.864339: rtos_queue_peek_from_isr_failed: tstamp:13109117367 queue:0x0b4a3c58
kworker/4:2-268 [004] …1 408.968515: rtos_queue_peek_from_isr_failed: tstamp:13111605847 queue:0x0b4a3c58

kernel_log:
[ 406.617808] tegra-vi4 15700000.vi: Create Surface with imgW=1920, imgH=1080, memFmt=200
[ 406.734562] video4linux video1: tegra_channel_capture_frame: vi4 got SOF syncpt buf[ffffffc1ebee3800]
[ 406.760700] video4linux video1: tegra_channel_release_frame: vi4 got EOF syncpt buf[ffffffc1ebee3800]
[ 406.824293] tegra-vi4 15700000.vi: Status: 2 channel:00 frame:0001
[ 406.847276] tegra-vi4 15700000.vi: timestamp sof 417388399584 eof 417428389536 data 0x000000a4
[ 406.856720] tegra-vi4 15700000.vi: capture_id 5 stream 4 vchan 0
[ 407.824527] tegra-vi4 15700000.vi: PXL_SOF syncpt timeout! err = -11
[ 407.831169] video4linux video1: tegra_channel_capture_frame: vi4 got SOF syncpt buf[ffffffc1ebee2800]
[ 408.892465] tegra-vi4 15700000.vi: ATOMP_FE syncpt timeout!
[ 409.484983] tegra_mipi_cal 3990000.mipical: tegra_mipi_bias_pad_disable

hello liukejob,

since you had use FPGA to create MIPI signals into the CSI port, Tegra side recognize the sources as general CSI-camera.
there’s know issues with TX2’s VI drivers, could you please apply these kernel patches to correct frame end syncpt wait.
thanks
Jul25_topic1037809.tar.gz (1.82 KB)

Hi JerryChang:
Thanks for your reply, after we apply the patch. Even the first frame of the image is not available. We use v4l2 method to test, the “VIDIOC_DQBUF: failed: Input/output error” occurs when capture the first frame.Could you give us more advise? Thanks a lot.
We found a little difference in trace log , there 's a CHANSEL_LOAD_FRAMED occurs.

tracer: nop

entries-in-buffer/entries-written: 23/23 #P:4

_-----=> irqs-off

/ _----=> need-resched

| / _—=> hardirq/softirq

|| / _–=> preempt-depth

||| / delay

TASK-PID CPU# |||| TIMESTAMP FUNCTION

| | | |||| | |

 kworker/0:1-115   [000] ...1   297.873582: rtos_queue_peek_from_isr_failed: tstamp:9641197806 queue:0x0b4a3c58
 kworker/0:1-115   [000] ...1   297.873586: rtcpu_start: tstamp:9641198785
 kworker/0:1-115   [000] ...1   297.925602: rtcpu_vinotify_handle_msg: tstamp:9643150665 tag:CSIMUX_STREAM channel:0xff frame:0 vi_tstamp:1053215651 data:0x00000100
 kworker/0:1-115   [000] ...1   297.925604: rtcpu_vinotify_handle_msg: tstamp:9643210791 tag:CHANSEL_PXL_SOF channel:0x00 frame:1 vi_tstamp:1053275652 data:0x00000001
 kworker/0:1-115   [000] ...1   297.925605: rtcpu_vinotify_handle_msg: tstamp:9643210942 tag:ATOMP_FS channel:0x00 frame:1 vi_tstamp:1053275711 data:0x00000000
 kworker/0:1-115   [000] ...1   297.925606: rtcpu_vinotify_handle_msg: tstamp:9643213135 tag:CHANSEL_LOAD_FRAMED channel:0x04 frame:1 vi_tstamp:1053278132 data:0x08000000
 kworker/0:1-115   [000] ...1   297.981602: rtcpu_vinotify_handle_msg: tstamp:9644430313 tag:CHANSEL_PXL_EOF channel:0x00 frame:1 vi_tstamp:1054495309 data:0x02610002
 kworker/0:1-115   [000] ...1   297.981604: rtcpu_vinotify_handle_msg: tstamp:9644460480 tag:CSIMUX_FRAME channel:0x00 frame:1 vi_tstamp:1054525309 data:0x000000a2
 kworker/0:1-115   [000] ...1   297.981605: rtcpu_vinotify_handle_msg: tstamp:9644460667 tag:ATOMP_FE channel:0x00 frame:1 vi_tstamp:1054525312 data:0x00000000
 kworker/0:1-115   [000] ...1   298.033607: rtos_queue_peek_from_isr_failed: tstamp:9646198676 queue:0x0b4a3c58
 kworker/0:1-115   [000] ...1   298.189676: rtos_queue_peek_from_isr_failed: tstamp:9651199391 queue:0x0b4a3c58
 kworker/0:1-115   [000] ...1   298.345661: rtos_queue_peek_from_isr_failed: tstamp:9656199900 queue:0x0b4a3c58
 kworker/0:1-115   [000] ...1   298.501662: rtos_queue_peek_from_isr_failed: tstamp:9661200406 queue:0x0b4a3c58
 kworker/0:1-115   [000] ...1   298.657667: rtos_queue_peek_from_isr_failed: tstamp:9666200910 queue:0x0b4a3c58
 kworker/0:1-115   [000] ...1   298.813687: rtos_queue_peek_from_isr_failed: tstamp:9671201421 queue:0x0b4a3c58
 kworker/0:1-115   [000] ...1   298.977707: rtos_queue_peek_from_isr_failed: tstamp:9676201926 queue:0x0b4a3c58
 kworker/0:1-115   [000] ...1   299.133667: rtos_queue_peek_from_isr_failed: tstamp:9681202439 queue:0x0b4a3c58
 kworker/0:1-115   [000] ...1   299.341661: rtos_queue_peek_from_isr_failed: tstamp:9686202938 queue:0x0b4a3c58
 kworker/0:1-115   [000] ...1   299.497662: rtos_queue_peek_from_isr_failed: tstamp:9691203452 queue:0x0b4a3c58
 kworker/0:1-115   [000] ...1   299.653655: rtos_queue_peek_from_isr_failed: tstamp:9696203952 queue:0x0b4a3c58
 kworker/0:1-115   [000] ...1   299.809659: rtos_queue_peek_from_isr_failed: tstamp:9701204470 queue:0x0b4a3c58
 kworker/0:1-115   [000] ...1   299.965709: rtos_queue_peek_from_isr_failed: tstamp:9706204968 queue:0x0b4a3c58
 kworker/0:1-115   [000] ...1   299.965718: rtos_queue_peek_from_isr_failed: tstamp:9706227401 queue:0x0b4a3c58

hello liukejob,

CHANSEL_LOAD_FRAMED channel:0x04 frame:1 vi_tstamp:1053278132 data:0x08000000

there’s LOAD_FRAMED event to process the frame, this event is only expected after FE.

couple of questions as below,

  1. did you increase the timeout values manually ?
  2. is there any suspicious kernel failures.
    thanks

hello JerryChang:
Thanks for your reply.

  1. we didn’t change the chan->timout this time
  2. the kernel log almost as same as apply the patch before
  3. we notice that in jetpack3.0-tx1 the csi_settle=0(15 cycles), cil_settle=0xa(15 cycles) .we also try to change csi_settle=23(30 cycles) and cil settle_time=24(30 cycles) but without effect.
    Could you give us more advise thanks a lot

kernel_log:
[ 420.562567] nvcsi 150c0000.nvcsi: csi4_start_streaming ports index=2, lanes=1
[ 420.569710] nvcsi 150c0000.nvcsi: csi4_stream_init
[ 420.574548] nvcsi 150c0000.nvcsi: csi4_stream_config
[ 420.579543] nvcsi 150c0000.nvcsi: csi4_stream_config (2) read VC0_DPCM_CTRL = 00000000
[ 420.587473] nvcsi 150c0000.nvcsi: csi4_phy_config
[ 420.592193] nvcsi 150c0000.nvcsi: NVCSI_CIL_CONFIG = 00000000
[ 420.597958] nvcsi 150c0000.nvcsi: cil_settingtime is pulled from device
[ 420.604573] nvcsi 150c0000.nvcsi: cil core clock: 204, csi clock: 102
[ 420.611015] nvcsi 150c0000.nvcsi: cil_settingtime was autocalculated
[ 420.617368] nvcsi 150c0000.nvcsi: csi settle time: 33, cil settle time: 25
[ 420.676328] tegra-vi4 15700000.vi: Status: 2 channel:00 frame:0001
[ 420.682629] tegra-vi4 15700000.vi: timestamp sof 431303594528 eof 431343583584 data 0x000000a2
[ 420.692064] tegra-vi4 15700000.vi: capture_id 14 stream 2 vchan 0
[ 421.634286] tegra-vi4 15700000.vi: ATOMP_FE syncpt timeout! err = -11
[ 421.634311] tegra-vi4 15700000.vi: PXL_SOF syncpt timeout! err = -11
[ 422.646165] tegra-vi4 15700000.vi: ATOMP_FE syncpt timeout!
[ 422.652273] nvcsi 150c0000.nvcsi: csi4_stop_streaming ports index=0, lanes=1
[ 422.659910] nvcsi 150c0000.nvcsi: csi4_phy_config
[ 422.665352] nvcsi 150c0000.nvcsi: NVCSI_CIL_CONFIG = 00000001
[ 422.671440] nvcsi 150c0000.nvcsi: csi4_stream_check_status
[ 422.677182] nvcsi 150c0000.nvcsi: csi4_cil_check_status 342
[ 423.194558] tegra_mipi_cal 3990000.mipical: tegra_mipi_bias_pad_disable

hello liukejob,

beside patches from comment #2, please apply two more kernel patches to add TX2 error handling mechanism.
I’ve include all the 4 patches and upload them as new tar file to the attachment,
thanks
Jul26_topic1037809.tar.gz (11.4 KB)

Hi JerryChang,
Thanks very much for your help,after we apply the patch, we use command “st-launch-1.0 v4l2src device=”/dev/video1" ! “video/x-raw, width=1920,height=1080, format=(string)I420” ! xvimagesink -e" to test.
Now we can only get one frame, the gstreamer is crashed. The gstreamer output, kernel log, trace log is different from before.Could you give us more advise, Thanks a lot !!!

gstreamer output:
Setting pipeline to PAUSED …
Pipeline is live and does not need PREROLL …
Setting pipeline to PLAYING …
New clock: GstSystemClock
Segmentation fault (core dumped)

kenel log:
[ 56.017094] tegra_mipi_cal 3990000.mipical: tegra_mipi_bias_pad_enable
[ 56.027164] nvcsi 150c0000.nvcsi: csi port:2
[ 56.031511] tegra_mipi_cal 3990000.mipical: tegra_mipi_calibration
[ 56.057125] nvcsi 150c0000.nvcsi: csi port:4
[ 56.061460] tegra_mipi_cal 3990000.mipical: tegra_mipi_calibration
[ 56.426499] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 720 x 610
[ 56.528399] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 56.573998] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 720 x 610
[ 56.675686] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 56.721205] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 720 x 610
[ 56.822878] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 56.929112] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 1920 x 1080
[ 57.031117] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 57.076807] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 1920 x 1080
[ 57.178826] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 57.224510] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 1920 x 1080
[ 57.326516] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 57.372219] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 720 x 610
[ 57.473898] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 57.539628] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 720 x 610
[ 57.641285] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 57.707037] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 720 x 610
[ 57.808708] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 57.854212] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 720 x 610
[ 57.955863] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 58.001377] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 720 x 610
[ 58.103048] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 58.148558] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 1920 x 1080
[ 58.250566] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 58.316470] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 1920 x 1080
[ 58.418470] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 58.484396] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 1920 x 1080
[ 58.586407] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 58.632089] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 1920 x 1080
[ 58.734090] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 58.779775] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 1920 x 1080
[ 58.881789] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 58.927481] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 720 x 610
[ 59.029148] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 59.094894] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 720 x 610
[ 59.196551] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 59.262293] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 720 x 610
[ 59.363962] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 59.409470] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 720 x 610
[ 59.511134] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 59.556646] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 720 x 610
[ 59.658352] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 59.703873] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 1920 x 1080
[ 59.805880] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 59.871792] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 1920 x 1080
[ 59.973796] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 60.039718] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 1920 x 1080
[ 60.141755] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 60.187434] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 1920 x 1080
[ 60.289437] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 60.335134] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 1920 x 1080
[ 60.437148] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 60.482857] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 720 x 610
[ 60.584517] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 60.650257] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 720 x 610
[ 60.751916] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 60.817656] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 720 x 610
[ 60.919326] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 60.964834] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 720 x 610
[ 61.066507] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 61.112022] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 720 x 610
[ 61.213689] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 61.259199] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 1920 x 1080
[ 61.361203] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 61.427112] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 1920 x 1080
[ 61.529124] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 61.595057] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 1920 x 1080
[ 61.697068] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 61.742747] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 1920 x 1080
[ 61.844754] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 61.890440] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 1920 x 1080
[ 61.992445] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 62.038143] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 720 x 610
[ 62.139814] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 62.205558] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 720 x 610
[ 62.307221] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 62.372962] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 720 x 610
[ 62.474625] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 62.520140] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 720 x 610
[ 62.621801] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 62.667312] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 720 x 610
[ 62.768973] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 62.814481] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 1920 x 1080
[ 62.916487] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 62.982389] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 1920 x 1080
[ 63.084407] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 63.150331] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 1920 x 1080
[ 63.252349] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 63.298028] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 1920 x 1080
[ 63.400036] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 63.445718] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 1920 x 1080
[ 63.547745] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 63.593543] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 1920 x 1080
[ 63.695557] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 63.757557] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 1920 x 1080
[ 63.859570] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 63.905247] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_s_fmt(8200) size 1920 x 1080
[ 63.913769] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 1920 x 1080
[ 64.015773] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 64.087893] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_g_fmt++
[ 64.096054] nvcsi 150c0000.nvcsi: csi4_start_streaming ports index=4, lanes=2
[ 64.103233] nvcsi 150c0000.nvcsi: csi4_stream_init
[ 64.108115] nvcsi 150c0000.nvcsi: csi4_stream_config
[ 64.113117] nvcsi 150c0000.nvcsi: csi4_stream_config (4) read VC0_DPCM_CTRL = 00000000
[ 64.121046] nvcsi 150c0000.nvcsi: csi4_phy_config
[ 64.125802] nvcsi 150c0000.nvcsi: NVCSI_CIL_CONFIG = 00000000
[ 64.131571] nvcsi 150c0000.nvcsi: cil_settingtime is pulled from device
[ 64.138188] nvcsi 150c0000.nvcsi: cil core clock: 204, csi clock: 102
[ 64.144681] nvcsi 150c0000.nvcsi: cil_settingtime was autocalculated
[ 64.151046] nvcsi 150c0000.nvcsi: csi settle time: 33, cil settle time: 25
[ 65.184443] tegra-vi4 15700000.vi: PXL_SOF syncpt timeout! err = -11
[ 65.190964] tegra-vi4 15700000.vi: tegra_channel_error_recovery: attempting to reset the capture channel
[ 65.201591] nvcsi 150c0000.nvcsi: csi4_error_recover: resetting nvcsi stream 4
[ 65.208995] nvcsi 150c0000.nvcsi: csi4_stop_streaming ports index=0, lanes=2
[ 65.216189] nvcsi 150c0000.nvcsi: csi4_phy_config
[ 65.220970] nvcsi 150c0000.nvcsi: NVCSI_CIL_CONFIG = 00000002
[ 65.226823] nvcsi 150c0000.nvcsi: csi4_stream_check_status
[ 65.232376] nvcsi 150c0000.nvcsi: csi4_cil_check_status 354
[ 65.238012] nvcsi 150c0000.nvcsi: csi4_cil_check_status (4) CIL_INTR_STATUS 0x00000044
[ 65.245983] nvcsi 150c0000.nvcsi: csi4_cil_check_status (4) CIL_ERR_INTR_STATUS 0x00000044
[ 65.254297] nvcsi 150c0000.nvcsi: csi4_start_streaming ports index=4, lanes=2
[ 65.261493] nvcsi 150c0000.nvcsi: csi4_stream_init
[ 65.266325] nvcsi 150c0000.nvcsi: csi4_stream_config
[ 65.271324] nvcsi 150c0000.nvcsi: csi4_stream_config (4) read VC0_DPCM_CTRL = 00000000
[ 65.279296] nvcsi 150c0000.nvcsi: csi4_phy_config
[ 65.284026] nvcsi 150c0000.nvcsi: NVCSI_CIL_CONFIG = 00000000
[ 65.289825] nvcsi 150c0000.nvcsi: cil_settingtime is pulled from device
[ 65.296456] nvcsi 150c0000.nvcsi: cil core clock: 204, csi clock: 102
[ 65.302935] nvcsi 150c0000.nvcsi: cil_settingtime was autocalculated
[ 65.309337] nvcsi 150c0000.nvcsi: csi settle time: 33, cil settle time: 25
[ 65.384667] tegra-vi4 15700000.vi: Status: 2 channel:00 frame:0002
[ 65.391058] tegra-vi4 15700000.vi: timestamp sof 76043061056 eof 76076389344 data 0x000000a4
[ 65.400363] tegra-vi4 15700000.vi: capture_id 3 stream 4 vchan 0
[ 77.294757] nvcsi 150c0000.nvcsi: csi4_stop_streaming ports index=0, lanes=2
[ 77.301846] nvcsi 150c0000.nvcsi: csi4_phy_config
[ 77.306581] nvcsi 150c0000.nvcsi: NVCSI_CIL_CONFIG = 00000002
[ 77.312406] nvcsi 150c0000.nvcsi: csi4_stream_check_status
[ 77.317916] nvcsi 150c0000.nvcsi: csi4_stream_check_status (4) ERROR_STATUS2VI_VC0 = 0x00000004
[ 77.326656] nvcsi 150c0000.nvcsi: csi4_stream_check_status (4) INTR_STATUS 0x00000004
[ 77.334490] nvcsi 150c0000.nvcsi: csi4_stream_check_status (4) ERR_INTR_STATUS 0x00000004
[ 77.342702] nvcsi 150c0000.nvcsi: csi4_cil_check_status 354
[ 77.348281] nvcsi 150c0000.nvcsi: csi4_cil_check_status (4) CIL_INTR_STATUS 0x00000046
[ 77.356195] nvcsi 150c0000.nvcsi: csi4_cil_check_status (4) CIL_ERR_INTR_STATUS 0x00000046
[ 77.864449] tegra_mipi_cal 3990000.mipical: tegra_mipi_bias_pad_disable

trace log:
root@tegra-ubuntu:/home/nvidia/work# cat /sys/kernel/debug/tracing/trace

tracer: nop

entries-in-buffer/entries-written: 99/99 #P:4

_-----=> irqs-off

/ _----=> need-resched

| / _—=> hardirq/softirq

|| / _–=> preempt-depth

||| / delay

TASK-PID CPU# |||| TIMESTAMP FUNCTION

| | | |||| | |

 kworker/0:1-51    [000] ...1    64.116265: rtos_queue_peek_from_isr_failed: tstamp:2337088060 queue:0x0b4a3c58
 kworker/0:1-51    [000] ...1    64.116269: rtcpu_start: tstamp:2337088957
 kworker/0:1-51    [000] ...1    64.168262: rtcpu_vinotify_handle_msg: tstamp:2339055715 tag:CSIMUX_STREAM channel:0xff frame:0 vi_tstamp:2339055277 data:0x00010000
 kworker/0:1-51    [000] ...1    64.220300: rtcpu_vinotify_handle_msg: tstamp:2339889134 tag:CHANSEL_PXL_SOF channel:0x00 frame:2 vi_tstamp:2339888583 data:0x00000001
 kworker/0:1-51    [000] ...1    64.220309: rtcpu_vinotify_handle_msg: tstamp:2339889296 tag:ATOMP_FS channel:0x00 frame:2 vi_tstamp:2339888595 data:0x00000000
 kworker/0:1-51    [000] ...1    64.220311: rtcpu_vinotify_handle_msg: tstamp:2339891152 tag:CHANSEL_LOAD_FRAMED channel:0x10 frame:2 vi_tstamp:2339890740 data:0x08000000
 kworker/0:1-51    [000] ...1    64.220313: rtcpu_vinotify_handle_msg: tstamp:2340888869 tag:CHANSEL_PXL_EOF channel:0x00 frame:2 vi_tstamp:2340888426 data:0x04370002
 kworker/0:1-51    [000] ...1    64.220315: rtcpu_vinotify_handle_msg: tstamp:2340930703 tag:CSIMUX_FRAME channel:0x00 frame:2 vi_tstamp:2340930091 data:0x000000a4
 kworker/0:1-51    [000] ...1    64.220317: rtcpu_vinotify_handle_msg: tstamp:2340930937 tag:ATOMP_FE channel:0x00 frame:2 vi_tstamp:2340930095 data:0x00000000
 kworker/0:1-51    [000] ...1    64.272456: rtos_queue_peek_from_isr_failed: tstamp:2342089223 queue:0x0b4a3c58
 kworker/0:1-51    [000] ...1    64.428406: rtos_queue_peek_from_isr_failed: tstamp:2347089737 queue:0x0b4a3c58
 kworker/0:1-51    [000] ...1    64.584359: rtos_queue_peek_from_isr_failed: tstamp:2352089991 queue:0x0b4a3c58
 kworker/0:1-51    [000] ...1    64.740369: rtos_queue_peek_from_isr_failed: tstamp:2357090672 queue:0x0b4a3c58
 kworker/0:1-51    [000] ...1    64.896448: rtos_queue_peek_from_isr_failed: tstamp:2362091172 queue:0x0b4a3c58
 kworker/0:1-51    [000] ...1    65.104325: rtos_queue_peek_from_isr_failed: tstamp:2367091683 queue:0x0b4a3c58
 kworker/0:1-51    [000] ...1    65.208362: rtos_queue_peek_from_isr_failed: tstamp:2371666473 queue:0x0b4a3c58
 kworker/0:1-51    [000] ...1    65.368254: rtos_queue_peek_from_isr_failed: tstamp:2375343458 queue:0x0b4a3c58
 kworker/0:1-51    [000] ...1    65.368258: rtcpu_start: tstamp:2375344450
 kworker/0:1-51    [000] ...1    65.368259: rtcpu_vinotify_handle_msg: tstamp:2376346297 tag:CSIMUX_FRAME channel:0x00 frame:2 vi_tstamp:2376345537 data:0x000000a4
 kworker/0:1-51    [000] ...1    65.368260: rtcpu_vinotify_handle_msg: tstamp:2376346451 tag:CHANSEL_PXL_SOF channel:0x00 frame:2 vi_tstamp:2376345658 data:0x00000001
 kworker/0:1-51    [000] ...1    65.368261: rtcpu_vinotify_handle_msg: tstamp:2376346600 tag:ATOMP_FS channel:0x00 frame:2 vi_tstamp:2376345671 data:0x00000000
 kworker/0:1-51    [000] ...1    65.420247: rtcpu_vinotify_handle_msg: tstamp:2377345922 tag:CHANSEL_PXL_EOF channel:0x00 frame:2 vi_tstamp:2377345502 data:0x04370002
 kworker/0:1-51    [000] ...1    65.420250: rtcpu_vinotify_handle_msg: tstamp:2377387774 tag:CSIMUX_FRAME channel:0x00 frame:2 vi_tstamp:2377387167 data:0x000000a4
 kworker/0:1-51    [000] ...1    65.420251: rtcpu_vinotify_handle_msg: tstamp:2377388020 tag:ATOMP_FE channel:0x00 frame:2 vi_tstamp:2377387171 data:0x00000000
 kworker/0:1-51    [000] ...1    65.524264: rtos_queue_peek_from_isr_failed: tstamp:2380344321 queue:0x0b4a3c58
 kworker/0:1-51    [000] ...1    65.680256: rtos_queue_peek_from_isr_failed: tstamp:2385344837 queue:0x0b4a3c58
 kworker/0:1-51    [000] ...1    65.836246: rtos_queue_peek_from_isr_failed: tstamp:2390345343 queue:0x0b4a3c58
 kworker/0:1-51    [000] ...1    65.992241: rtos_queue_peek_from_isr_failed: tstamp:2395345830 queue:0x0b4a3c58
 kworker/0:1-51    [000] ...1    66.148240: rtos_queue_peek_from_isr_failed: tstamp:2400346339 queue:0x0b4a3c58
 kworker/0:1-51    [000] ...1    66.304240: rtos_queue_peek_from_isr_failed: tstamp:2405346844 queue:0x0b4a3c58
 kworker/0:1-51    [000] ...1    66.460256: rtos_queue_peek_from_isr_failed: tstamp:2410347352 queue:0x0b4a3c58
 kworker/0:1-51    [000] ...1    66.616250: rtos_queue_peek_from_isr_failed: tstamp:2415347857 queue:0x0b4a3c58
 kworker/0:1-51    [000] ...1    66.772250: rtos_queue_peek_from_isr_failed: tstamp:2420348372 queue:0x0b4a3c58
 kworker/0:1-51    [000] ...1    66.928246: rtos_queue_peek_from_isr_failed: tstamp:2425348870 queue:0x0b4a3c58
 kworker/0:1-51    [000] ...1    67.084256: rtos_queue_peek_from_isr_failed: tstamp:2430349378 queue:0x0b4a3c58
 kworker/0:1-51    [000] ...1    67.240250: rtos_queue_peek_from_isr_failed: tstamp:2435349887 queue:0x0b4a3c58
 kworker/0:1-51    [000] ...1    67.448249: rtos_queue_peek_from_isr_failed: tstamp:2440350391 queue:0x0b4a3c58
 kworker/0:1-51    [000] ...1    67.604243: rtos_queue_peek_from_isr_failed: tstamp:2445350900 queue:0x0b4a3c58
 kworker/0:1-51    [000] ...1    67.760241: rtos_queue_peek_from_isr_failed: tstamp:2450351404 queue:0x0b4a3c58
 kworker/0:1-51    [000] ...1    67.916245: rtos_queue_peek_from_isr_failed: tstamp:2455351913 queue:0x0b4a3c58
 kworker/0:1-51    [000] ...1    68.072239: rtos_queue_peek_from_isr_failed: tstamp:2460352421 queue:0x0b4a3c58
 kworker/0:1-51    [000] ...1    68.228246: rtos_queue_peek_from_isr_failed: tstamp:2465352926 queue:0x0b4a3c58
 kworker/0:1-51    [000] ...1    68.384240: rtos_queue_peek_from_isr_failed: tstamp:2470353434 queue:0x0b4a3c58
 kworker/0:1-51    [000] ...1    68.540239: rtos_queue_peek_from_isr_failed: tstamp:2475353939 queue:0x0b4a3c58
 kworker/0:1-51    [000] ...1    68.696238: rtos_queue_peek_from_isr_failed: tstamp:2480354447 queue:0x0b4a3c58
 kworker/0:1-51    [000] ...1    68.852238: rtos_queue_peek_from_isr_failed: tstamp:2485354955 queue:0x0b4a3c58
 kworker/0:1-51    [000] ...1    69.008239: rtos_queue_peek_from_isr_failed: tstamp:2490355460 queue:0x0b4a3c58
 kworker/0:1-51    [000] ...1    69.164241: rtos_queue_peek_from_isr_failed: tstamp:2495355965 queue:0x0b4a3c58
 kworker/0:1-51    [000] ...1    69.320242: rtos_queue_peek_from_isr_failed: tstamp:2500356474 queue:0x0b4a3c58
 kworker/0:1-51    [000] ...1    69.528243: rtos_queue_peek_from_isr_failed: tstamp:2505356982 queue:0x0b4a3c58
 kworker/0:1-51    [000] ...1    69.684239: rtos_queue_peek_from_isr_failed: tstamp:2510357487 queue:0x0b4a3c58
 kworker/0:1-51    [000] ...1    69.840238: rtos_queue_peek_from_isr_failed: tstamp:2515357995 queue:0x0b4a3c58

hello liukejob,

couple of suggestion as below,

  1. according to
CSIMUX_FRAME channel:0x00 frame:2 vi_tstamp:2376345537 data:0x000000a4

there’s FS fault in the streaming,
since we’re using different VI driver between TX1 and TX2.
could you please check your FPGA device to make sure there is a pair FS,FE in the MIPI signaling.
for example,
Tegra expect MIPI as below

[FS,FE]... [FS,FE]...

but your tracing messages looks like you had couple of FS in the beginning.

[FSFS,FE]... [FSFS,FE]...
  1. may I know did you have two sensor modes in the configuration, (720x610 and 1920x1080)
    according to
CHANSEL_PXL_EOF channel:0x00 frame:2 vi_tstamp:2340888426 data:0x04370002

the streaming coming to VI is 0x0437= 1079 lines,
please have another testing by disable 720x610 sensor mode.
thanks

Hi JerryChang,
We appreciate your help and your patience!
1) Unfortunately the FPGA is provided by others, we need time to contact with them.
2) We remove the 720x610 camera in dtsi and driver,only left the 1920x1080 camera then do the test.
The result is the same, only one frame can be captured and then gstreamer crashed.
But we noticed that the gstreamer output is different in the first time.
The kernel log and trace log seems no difference compared with the previous logs.
Next few days we will try to contact the FPGA provider, Thank you very much for your help!

gstreamer output fist time:
etting pipeline to PAUSED …
Pipeline is live and does not need PREROLL …
Setting pipeline to PLAYING …
New clock: GstSystemClock
ERROR: from element /GstPipeline:pipeline0/GstV4l2Src:v4l2src0: Could not read from resource.
Additional debug info:
gstv4l2bufferpool.c(1054): gst_v4l2_buffer_pool_poll (): /GstPipeline:pipeline0/GstV4l2Src:v4l2src0:
poll error 1: Resource temporarily unavailable (11)
EOS on shutdown enabled – waiting for EOS after Error
Waiting for EOS…
ERROR: from element /GstPipeline:pipeline0/GstV4l2Src:v4l2src0: Failed to allocate a buffer
Additional debug info:
gstv4l2src.c(884): gst_v4l2src_create (): /GstPipeline:pipeline0/GstV4l2Src:v4l2src0
ERROR: from element /GstPipeline:pipeline0/GstV4l2Src:v4l2src0: Internal data flow error.
Additional debug info:
gstbasesrc.c(2948): gst_base_src_loop (): /GstPipeline:pipeline0/GstV4l2Src:v4l2src0:
streaming task paused, reason error (-5)
Got EOS from element “pipeline0”.
EOS received - stopping pipeline…
Execution ended after 0:00:05.569617706
Setting pipeline to PAUSED …
Setting pipeline to READY …
Setting pipeline to NULL …
Freeing pipeline …

gstream run second time:
Setting pipeline to PAUSED …
Pipeline is live and does not need PREROLL …
Setting pipeline to PLAYING …
New clock: GstSystemClock
Segmentation fault (core dumped)

trace log:

tracer: nop

entries-in-buffer/entries-written: 26/26 #P:4

_-----=> irqs-off

/ _----=> need-resched

| / _—=> hardirq/softirq

|| / _–=> preempt-depth

||| / delay

TASK-PID CPU# |||| TIMESTAMP FUNCTION

| | | |||| | |

 kworker/3:0-25    [003] ...1   134.936811: rtos_queue_peek_from_isr_failed: tstamp:4550258061 queue:0x0b4a3c58
 kworker/3:0-25    [003] ...1   134.936814: rtcpu_start: tstamp:4550258807
 kworker/3:0-25    [003] ...1   134.984814: rtcpu_vinotify_handle_msg: tstamp:4552230152 tag:CSIMUX_STREAM channel:0xff frame:0 vi_tstamp:257262409 data:0x00010000
 kworker/3:0-25    [003] ...1   134.984817: rtcpu_vinotify_handle_msg: tstamp:4552991345 tag:CHANSEL_PXL_SOF channel:0x00 frame:1 vi_tstamp:258023497 data:0x00000001
 kworker/3:0-25    [003] ...1   134.984818: rtcpu_vinotify_handle_msg: tstamp:4552991507 tag:ATOMP_FS channel:0x00 frame:1 vi_tstamp:258023510 data:0x00000000
 kworker/3:0-25    [003] ...1   134.984819: rtcpu_vinotify_handle_msg: tstamp:4552993547 tag:CHANSEL_LOAD_FRAMED channel:0x10 frame:1 vi_tstamp:258025835 data:0x08000000
 kworker/3:0-25    [003] ...1   135.036864: rtcpu_vinotify_handle_msg: tstamp:4553991113 tag:CHANSEL_PXL_EOF channel:0x00 frame:1 vi_tstamp:259023344 data:0x04370002
 kworker/3:0-25    [003] ...1   135.036873: rtcpu_vinotify_handle_msg: tstamp:4554032908 tag:CSIMUX_FRAME channel:0x00 frame:1 vi_tstamp:259065010 data:0x000000a4
 kworker/3:0-25    [003] ...1   135.036875: rtcpu_vinotify_handle_msg: tstamp:4554033154 tag:ATOMP_FE channel:0x00 frame:1 vi_tstamp:259065013 data:0x00000000
 kworker/3:0-25    [003] ...1   135.089003: rtos_queue_peek_from_isr_failed: tstamp:4555259010 queue:0x0b4a3c58
 kworker/3:0-25    [003] ...1   135.244996: rtos_queue_peek_from_isr_failed: tstamp:4560259724 queue:0x0b4a3c58
 kworker/3:0-25    [003] ...1   135.400854: rtos_queue_peek_from_isr_failed: tstamp:4565260378 queue:0x0b4a3c58
 kworker/3:0-25    [003] ...1   135.556845: rtos_queue_peek_from_isr_failed: tstamp:4570260662 queue:0x0b4a3c58
 kworker/3:0-25    [003] ...1   135.712830: rtos_queue_peek_from_isr_failed: tstamp:4575261167 queue:0x0b4a3c58
 kworker/3:0-25    [003] ...1   135.868777: rtos_queue_peek_from_isr_failed: tstamp:4580261676 queue:0x0b4a3c58
 kworker/3:0-25    [003] ...1   136.028664: rtos_queue_peek_from_isr_failed: tstamp:4584680752 queue:0x0b4a3c58
 kworker/3:0-25    [003] ...1   136.128638: rtos_queue_peek_from_isr_failed: tstamp:4588367480 queue:0x0b4a3c58
 kworker/3:0-25    [003] ...1   136.128641: rtcpu_start: tstamp:4588368943
 kworker/3:0-25    [003] ...1   136.128643: rtcpu_vinotify_handle_msg: tstamp:4588406996 tag:CSIMUX_FRAME channel:0x00 frame:1 vi_tstamp:293438935 data:0x000000a4
 kworker/3:0-25    [003] ...1   136.128644: rtcpu_vinotify_handle_msg: tstamp:4588407150 tag:CHANSEL_PXL_SOF channel:0x00 frame:1 vi_tstamp:293439056 data:0x00000001
 kworker/3:0-25    [003] ...1   136.128644: rtcpu_vinotify_handle_msg: tstamp:4588407299 tag:ATOMP_FS channel:0x00 frame:1 vi_tstamp:293439069 data:0x00000000
 kworker/3:0-25    [003] ...1   136.180676: rtcpu_vinotify_handle_msg: tstamp:4589406613 tag:CHANSEL_PXL_EOF channel:0x00 frame:1 vi_tstamp:294438904 data:0x04370002
 kworker/3:0-25    [003] ...1   136.180682: rtcpu_vinotify_handle_msg: tstamp:4589448449 tag:CSIMUX_FRAME channel:0x00 frame:1 vi_tstamp:294480569 data:0x000000a4
 kworker/3:0-25    [003] ...1   136.180684: rtcpu_vinotify_handle_msg: tstamp:4589448642 tag:ATOMP_FE channel:0x00 frame:1 vi_tstamp:294480573 data:0x00000000
 kworker/3:0-25    [003] ...1   136.288736: rtos_queue_peek_from_isr_failed: tstamp:4593368643 queue:0x0b4a3c58
 kworker/3:0-25    [003] ...1   136.288762: rtos_queue_peek_from_isr_failed: tstamp:4593375727 queue:0x0b4a3c58

kernel log:
[ 130.502513] tegra_mipi_cal 3990000.mipical: tegra_mipi_bias_pad_enable
[ 130.510275] nvcsi 150c0000.nvcsi: csi port:4
[ 130.514620] tegra_mipi_cal 3990000.mipical: tegra_mipi_calibration
[ 130.824426] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 1920 x 1080
[ 130.927144] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 130.973177] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 1920 x 1080
[ 131.075677] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 131.121570] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 1920 x 1080
[ 131.223844] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 131.269630] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 1920 x 1080
[ 131.371828] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 131.437843] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 1920 x 1080
[ 131.540035] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 131.606078] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 1920 x 1080
[ 131.708265] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 131.754017] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 1920 x 1080
[ 131.856207] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 131.901963] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 1920 x 1080
[ 132.004144] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 132.049860] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 1920 x 1080
[ 132.151893] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 132.217800] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 1920 x 1080
[ 132.319803] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 132.385735] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 1920 x 1080
[ 132.487738] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 132.533427] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 1920 x 1080
[ 132.635433] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 132.681139] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 1920 x 1080
[ 132.783154] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 132.828852] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 1920 x 1080
[ 132.930864] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 132.996771] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 1920 x 1080
[ 133.098780] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 133.164718] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 1920 x 1080
[ 133.266726] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 133.312406] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 1920 x 1080
[ 133.414404] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 133.460092] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 1920 x 1080
[ 133.562093] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 133.607786] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 1920 x 1080
[ 133.709807] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 133.775708] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 1920 x 1080
[ 133.877709] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 133.943626] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 1920 x 1080
[ 134.045630] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 134.091310] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 1920 x 1080
[ 134.193327] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 134.239013] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 1920 x 1080
[ 134.341022] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 134.386813] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 1920 x 1080
[ 134.488821] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 134.550827] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 1920 x 1080
[ 134.652848] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 134.698530] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_s_fmt(8200) size 1920 x 1080
[ 134.707064] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: size 1920 x 1080
[ 134.809105] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_try_fmt: use_sensor_mode_id 0
[ 134.881314] tirvido_mipi_driver tirvideo_mipi_sdi: camera_common_g_fmt++
[ 134.889551] nvcsi 150c0000.nvcsi: csi4_start_streaming ports index=4, lanes=2
[ 134.896749] nvcsi 150c0000.nvcsi: csi4_stream_init
[ 134.901599] nvcsi 150c0000.nvcsi: csi4_stream_config
[ 134.906599] nvcsi 150c0000.nvcsi: csi4_stream_config (4) read VC0_DPCM_CTRL = 00000000
[ 134.914566] nvcsi 150c0000.nvcsi: csi4_phy_config
[ 134.919298] nvcsi 150c0000.nvcsi: NVCSI_CIL_CONFIG = 00000000
[ 134.925087] nvcsi 150c0000.nvcsi: cil_settingtime is pulled from device
[ 134.931756] nvcsi 150c0000.nvcsi: cil core clock: 204, csi clock: 102
[ 134.938213] nvcsi 150c0000.nvcsi: cil_settingtime was autocalculated
[ 134.944619] nvcsi 150c0000.nvcsi: csi settle time: 33, cil settle time: 25
[ 135.972872] tegra-vi4 15700000.vi: PXL_SOF syncpt timeout! err = -11
[ 135.979459] tegra-vi4 15700000.vi: tegra_channel_error_recovery: attempting to reset the capture channel
[ 135.990010] nvcsi 150c0000.nvcsi: csi4_error_recover: resetting nvcsi stream 4
[ 135.997553] nvcsi 150c0000.nvcsi: csi4_stop_streaming ports index=0, lanes=2
[ 136.004707] nvcsi 150c0000.nvcsi: csi4_phy_config
[ 136.009558] nvcsi 150c0000.nvcsi: NVCSI_CIL_CONFIG = 00000002
[ 136.015431] nvcsi 150c0000.nvcsi: csi4_stream_check_status
[ 136.021032] nvcsi 150c0000.nvcsi: csi4_cil_check_status 354
[ 136.026673] nvcsi 150c0000.nvcsi: csi4_cil_check_status (4) CIL_INTR_STATUS 0x00000042
[ 136.034654] nvcsi 150c0000.nvcsi: csi4_cil_check_status (4) CIL_ERR_INTR_STATUS 0x00000042
[ 136.042964] nvcsi 150c0000.nvcsi: csi4_start_streaming ports index=4, lanes=2
[ 136.050148] nvcsi 150c0000.nvcsi: csi4_stream_init
[ 136.055003] nvcsi 150c0000.nvcsi: csi4_stream_config
[ 136.060041] nvcsi 150c0000.nvcsi: csi4_stream_config (4) read VC0_DPCM_CTRL = 00000000
[ 136.068009] nvcsi 150c0000.nvcsi: csi4_phy_config
[ 136.072741] nvcsi 150c0000.nvcsi: NVCSI_CIL_CONFIG = 00000000
[ 136.078537] nvcsi 150c0000.nvcsi: cil_settingtime is pulled from device
[ 136.085169] nvcsi 150c0000.nvcsi: cil core clock: 204, csi clock: 102
[ 136.091659] nvcsi 150c0000.nvcsi: cil_settingtime was autocalculated
[ 136.098052] nvcsi 150c0000.nvcsi: csi settle time: 33, cil settle time: 25
[ 136.142563] tegra-vi4 15700000.vi: Status: 2 channel:00 frame:0001
[ 136.148841] tegra-vi4 15700000.vi: timestamp sof 146829003264 eof 146862331680 data 0x000000a4
[ 136.158251] tegra-vi4 15700000.vi: capture_id 6 stream 4 vchan 0
[ 136.260903] nvcsi 150c0000.nvcsi: csi4_stop_streaming ports index=0, lanes=2
[ 136.268237] nvcsi 150c0000.nvcsi: csi4_phy_config
[ 136.273369] nvcsi 150c0000.nvcsi: NVCSI_CIL_CONFIG = 00000002
[ 136.279447] nvcsi 150c0000.nvcsi: csi4_stream_check_status
[ 136.285113] nvcsi 150c0000.nvcsi: csi4_cil_check_status 354
[ 136.290898] nvcsi 150c0000.nvcsi: csi4_cil_check_status (4) CIL_INTR_STATUS 0x00000046
[ 136.298959] nvcsi 150c0000.nvcsi: csi4_cil_check_status (4) CIL_ERR_INTR_STATUS 0x00000046
[ 136.848856] tegra_mipi_cal 3990000.mipical: tegra_mipi_bias_pad_disable

Hi JerryChang:
We can’t contact to the FPGA provider for the time being.
But we try to use oscilloscope to measure the mipi signal of Jetson DevKit camera to get some knowledge of mipi.
Our oscilloscope can only measure 200MHZ signal, by measuring the camera mipi signal. There are some questions hope to get your help:

  1. A short high speed signal(200mv signal)was found 184us beofore the start of the first frame line, is this the Frame start short packet ?
  2. A short high speed signal (200mv signal) was found 750ns later after the last frame line, is this the Frame end short packet?

If our guesswork is right,we will disassemble our device, measure the mipi signal of FPGA, and try to find some clues.Could you give us some help, thank you very much!
The attachment is the signal capture picture.
mipi-image.zip (628 KB)