How to receive pixel format RAW16 by NVCSI, VI?

Hi All,

We are using the Jetson TX2 board.
I want to receive RAW16 format (Data Type = 0x2E) using MIPI CAMERA SERIAL INTERFACE and VIDEO INPUT.

In Technical Reference Manual, available formats are below.

  • RAW 8ppc: RAW6, RAW7, RAW8, RAW10, RAW12, RAW14, embedded-8

So, we can’t receive RAW16 data as it is.
we have to VI_PIXFMT_WIDE register is enable (turn to 1), as RAW16 is merged RAW data input.
Despite setting this register, All the dumped RAW data by v4l2-ctl becomes 0.
MIPI timeout error (PXL_SOF syncpt timeout! err) is not occured.

Is there any missing setting?

-Thanks.

hello k0butanet,

please confirm the [Input Data Formats] in Technical Reference Manual, RAW16 is not supported by default. you need to merge to raw data by merging two RAW8 pixels.

  1. could you please share the JetPack release version for your development.
  2. may I know which sensor you’re working on?
  3. please share the detail failure message to us, you may also refer to Camera Bring Up page to enable tracing logs.

Hello, JerryChang,

It is not compatible with the data type (0x2E) of RAW 16, and we need to receive it as RAW8 (Data Type = 0x2A).

  1. could you please share the JetPack release version for your development.
    JetPack version is 3.1
    Linux for Tegra version is 28.1
  1. may I know which sensor you’re working on?
    Due to the circumstances here, but I can not present the sensor model number. I’m sorry.
    But I am using a Sony made sensor.
  1. please share the detail failure message to us, you may also refer to Camera Bring Up page to enable tracing logs.
    Log is below
# tracer: nop
#
# entries-in-buffer/entries-written: 50/50   #P:4
#
#                              _-----=> irqs-off
#                             / _----=> need-resched
#                            | / _---=> hardirq/softirq
#                            || / _--=> preempt-depth
#                            ||| /     delay
#           TASK-PID   CPU#  ||||    TIMESTAMP  FUNCTION
#              | |       |   ||||       |         |
     kworker/5:2-220   [005] ...1   454.223263: rtos_queue_peek_from_isr_failed: tstamp:14539887530 queue:0x0b4a3c58
     kworker/5:2-220   [005] ...1   454.223271: rtcpu_start: tstamp:14539889315
     kworker/5:2-220   [005] ...1   454.275248: rtcpu_vinotify_handle_msg: tstamp:14539968968 tag:CSIMUX_STREAM channel:0xff frame:0 vi_tstamp:1655066623 data:0x00010000
     kworker/5:2-220   [005] ...1   454.275251: rtcpu_vinotify_handle_msg: tstamp:14540577359 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:1655675029 data:0x00000000
     kworker/5:2-220   [005] ...1   454.275252: rtcpu_vinotify_handle_msg: tstamp:14540579792 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:1655677468 data:0x00000001
     kworker/5:2-220   [005] ...1   454.275254: rtcpu_vinotify_handle_msg: tstamp:14540582363 tag:CHANSEL_LOAD_FRAMED channel:0x10 frame:0 vi_tstamp:1655680030 data:0x08000000
     kworker/5:2-220   [005] ...1   454.275255: rtcpu_vinotify_handle_msg: tstamp:14541495800 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:1656593303 data:0x07530002
     kworker/5:2-220   [005] ...1   454.275256: rtcpu_vinotify_handle_msg: tstamp:14541495946 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:1656593326 data:0x00000000
     kworker/5:2-220   [005] ...1   454.275258: rtcpu_vinotify_handle_msg: tstamp:14541553926 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:1656651599 data:0x00000000
     kworker/5:2-220   [005] ...1   454.275259: rtcpu_vinotify_handle_msg: tstamp:14541556360 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:1656654039 data:0x00000001
     kworker/5:2-220   [005] ...1   454.275260: rtcpu_vinotify_handle_msg: tstamp:14541558615 tag:CHANSEL_LOAD_FRAMED channel:0x10 frame:0 vi_tstamp:1656656301 data:0x08000000
     kworker/5:2-220   [005] ...1   454.327275: rtcpu_vinotify_handle_msg: tstamp:14542472382 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:1657569870 data:0x07530002
     kworker/5:2-220   [005] ...1   454.327280: rtcpu_vinotify_handle_msg: tstamp:14542472522 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:1657569893 data:0x00000000
     kworker/5:2-220   [005] ...1   454.327281: rtcpu_vinotify_handle_msg: tstamp:14542530498 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:1657628168 data:0x00000000
     kworker/5:2-220   [005] ...1   454.327283: rtcpu_vinotify_handle_msg: tstamp:14542532927 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:1657630605 data:0x00000001
     kworker/5:2-220   [005] ...1   454.327285: rtcpu_vinotify_handle_msg: tstamp:14542535389 tag:CHANSEL_LOAD_FRAMED channel:0x10 frame:0 vi_tstamp:1657633075 data:0x08000000
     kworker/5:2-220   [005] ...1   454.379254: rtcpu_vinotify_handle_msg: tstamp:14543448926 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:1658546440 data:0x07530002
     kworker/5:2-220   [005] ...1   454.379257: rtcpu_vinotify_handle_msg: tstamp:14543449067 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:1658546463 data:0x00000000
     kworker/5:2-220   [005] ...1   454.379258: rtcpu_vinotify_handle_msg: tstamp:14543507059 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:1658604735 data:0x00000000
     kworker/5:2-220   [005] ...1   454.379259: rtcpu_vinotify_handle_msg: tstamp:14543509491 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:1658607175 data:0x00000001
     kworker/5:2-220   [005] ...1   454.379260: rtcpu_vinotify_handle_msg: tstamp:14544298875 tag:CHANSEL_LOAD_FRAMED channel:0x10 frame:0 vi_tstamp:1659396574 data:0x08000000
     kworker/5:2-220   [005] ...1   454.379260: rtcpu_vinotify_handle_msg: tstamp:14544425480 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:1659523010 data:0x07530002
     kworker/5:2-220   [005] ...1   454.379261: rtcpu_vinotify_handle_msg: tstamp:14544425585 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:1659523033 data:0x00000000
     kworker/5:2-220   [005] ...1   454.379262: rtcpu_vinotify_handle_msg: tstamp:14544483610 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:1659581306 data:0x00000000
     kworker/5:2-220   [005] ...1   454.379263: rtcpu_vinotify_handle_msg: tstamp:14544486041 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:1659583746 data:0x00000001
     kworker/5:2-220   [005] ...1   454.431251: rtos_queue_peek_from_isr_failed: tstamp:14544888421 queue:0x0b4a3c58
     kworker/5:2-220   [005] ...1   454.431254: rtcpu_vinotify_handle_msg: tstamp:14545197939 tag:CHANSEL_LOAD_FRAMED channel:0x10 frame:0 vi_tstamp:1660295636 data:0x08000000
     kworker/5:2-220   [005] ...1   454.431255: rtcpu_vinotify_handle_msg: tstamp:14545402045 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:1660499577 data:0x07530002
     kworker/5:2-220   [005] ...1   454.431256: rtcpu_vinotify_handle_msg: tstamp:14545402153 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:1660499601 data:0x00000000
     kworker/5:2-220   [005] ...1   454.431257: rtcpu_vinotify_handle_msg: tstamp:14545460179 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:1660557876 data:0x00000000
     kworker/5:2-220   [005] ...1   454.431257: rtcpu_vinotify_handle_msg: tstamp:14545462609 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:1660560313 data:0x00000001
     kworker/5:2-220   [005] ...1   454.431258: rtcpu_vinotify_handle_msg: tstamp:14546062648 tag:CHANSEL_LOAD_FRAMED channel:0x10 frame:0 vi_tstamp:1661160347 data:0x08000000
     kworker/5:2-220   [005] ...1   454.431259: rtcpu_vinotify_handle_msg: tstamp:14546378615 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:1661476147 data:0x07530002
     kworker/5:2-220   [005] ...1   454.431260: rtcpu_vinotify_handle_msg: tstamp:14546378721 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:1661476170 data:0x00000000
     kworker/5:2-220   [005] ...1   454.431260: rtcpu_vinotify_handle_msg: tstamp:14546436745 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:1661534443 data:0x00000000
     kworker/5:2-220   [005] ...1   454.431261: rtcpu_vinotify_handle_msg: tstamp:14546439180 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:1661536883 data:0x00000001
     kworker/5:2-220   [005] ...1   454.483259: rtcpu_vinotify_handle_msg: tstamp:14546930937 tag:CHANSEL_LOAD_FRAMED channel:0x10 frame:0 vi_tstamp:1662028635 data:0x08000000
     kworker/5:2-220   [005] ...1   454.483263: rtcpu_vinotify_handle_msg: tstamp:14547355186 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:1662452718 data:0x07530002
     kworker/5:2-220   [005] ...1   454.483264: rtcpu_vinotify_handle_msg: tstamp:14547355291 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:1662452740 data:0x00000000
     kworker/5:2-220   [005] ...1   454.483265: rtcpu_vinotify_handle_msg: tstamp:14547413318 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:1662511014 data:0x00000000
     kworker/5:2-220   [005] ...1   454.483266: rtcpu_vinotify_handle_msg: tstamp:14547415748 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:1662513453 data:0x00000001
     kworker/5:2-220   [005] ...1   454.483267: rtcpu_vinotify_handle_msg: tstamp:14547800435 tag:CHANSEL_LOAD_FRAMED channel:0x10 frame:0 vi_tstamp:1662898132 data:0x08000000
     kworker/5:2-220   [005] ...1   454.535256: rtcpu_vinotify_handle_msg: tstamp:14548331755 tag:CHANSEL_PXL_EOF channel:0x00 frame:0 vi_tstamp:1663429285 data:0x07530002
     kworker/5:2-220   [005] ...1   454.535261: rtcpu_vinotify_handle_msg: tstamp:14548331862 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:1663429307 data:0x00000000
     kworker/5:2-220   [005] ...1   454.535263: rtcpu_vinotify_handle_msg: tstamp:14548389886 tag:ATOMP_FS channel:0x00 frame:0 vi_tstamp:1663487583 data:0x00000000
     kworker/5:2-220   [005] ...1   454.535264: rtcpu_vinotify_handle_msg: tstamp:14548392328 tag:CHANSEL_PXL_SOF channel:0x00 frame:0 vi_tstamp:1663490020 data:0x00000001
     kworker/5:2-220   [005] ...1   454.535266: rtcpu_vinotify_handle_msg: tstamp:14548396697 tag:CHANSEL_LOAD_FRAMED channel:0x10 frame:0 vi_tstamp:1663493333 data:0x08000000
     kworker/5:2-220   [005] ...1   454.535267: rtcpu_vinotify_handle_msg: tstamp:14548396807 tag:CHANSEL_FAULT_FE channel:0x10 frame:0 vi_tstamp:1663493438 data:0x00000001
     kworker/5:2-220   [005] ...1   454.535269: rtcpu_vinotify_handle_msg: tstamp:14548397001 tag:ATOMP_FE channel:0x00 frame:0 vi_tstamp:1663493441 data:0x00000000
     kworker/5:2-220   [005] ...1   454.535273: rtos_queue_peek_from_isr_failed: tstamp:14549127059 queue:0x0b4a3c58

But, I try receiving two RAW8 pixels and merge two pixels.

Thanks a lot.

hello k0butanet,

since we already release JetPack-3.3 for Jetson-TX2.
may I know are you able to integrate your working process to the latest JetPack release for verification?
thanks

hello k0butanet,

sorry for late update.
unfortunately, our software driver has not implemented to support merging two RAW8 data into RAW16 input.
we also NOT going to support this in short term plans.
thanks

hello JerryChang,

sorry for late reply.

unfortunately, our software driver has not implemented to support merging two RAW8 data into RAW16 input.
I was aware.

thanks