Is there any solution for data logging system with 12-multi cameras?
Hello, experts I will build in the platform with 12-multi cameras or less cameras. I have not yet decided what format(raw, jpg, yuv) to store on the local. However, all formats are problematic for a long time to get huge amounts of data from sensors. So, I want to install some kind of storage device to store as long as possible. [b]Is there any solution for data logging system supported with drivepx2 and driveworks[/b]
Hello, experts

I will build in the platform with 12-multi cameras or less cameras.
I have not yet decided what format(raw, jpg, yuv) to store on the local.
However, all formats are problematic for a long time to get huge amounts of data from sensors.
So, I want to install some kind of storage device to store as long as possible.

Is there any solution for data logging system supported with drivepx2 and driveworks

#1
Posted 12/21/2017 08:47 AM   
Hello groot, You're right about the huge amounts of data that DriveWorks can record. The following FAQ should be helpful. https://devtalk.nvidia.com/default/topic/1007100/faq/data-logging/
Hello groot,
You're right about the huge amounts of data that DriveWorks can record. The following FAQ should be helpful.

https://devtalk.nvidia.com/default/topic/1007100/faq/data-logging/

#2
Posted 12/29/2017 11:55 PM   
[quote="kathy_nv"]Hello groot, You're right about the huge amounts of data that DriveWorks can record. The following FAQ should be helpful. https://devtalk.nvidia.com/default/topic/1007100/faq/data-logging/ [/quote] Hello, Kathy_nv. That's exactly what I want. But, USB3.0-SSD device is not befitting on drivepx2 in our case. It's bandwidth is between 400 and 500-megabytes per second, we want greater bandwidth to use 12-multi camera. ( width * height * 2 * fps = bytes/second, 1920 * 1208 * 2 * fps * 12(ea) = 55,664,640 byte/second = 55.66464 megabyte/second) If we use the USB3.0-SSD device, we can get just 9 fps images that is raw image of camera. It is too small size. 1. We saw some projects of reference on other teams, They have used a nas storage have 5G bandwidth with ethernet. [b]Is there official solution for the nas to store recorded data with drivepx2?[/b] 2. I know that drivepx2 have two processor can store recorded data. [b]How do I use two processors to sync and record data from sensors such as cameras, riders, GPS, and vehicles?[/b]
kathy_nv said:Hello groot,
You're right about the huge amounts of data that DriveWorks can record. The following FAQ should be helpful.
https://devtalk.nvidia.com/default/topic/1007100/faq/data-logging/



Hello, Kathy_nv.
That's exactly what I want.

But, USB3.0-SSD device is not befitting on drivepx2 in our case.
It's bandwidth is between 400 and 500-megabytes per second, we want greater bandwidth to use 12-multi camera.
( width * height * 2 * fps = bytes/second, 1920 * 1208 * 2 * fps * 12(ea) = 55,664,640 byte/second = 55.66464 megabyte/second)
If we use the USB3.0-SSD device, we can get just 9 fps images that is raw image of camera.
It is too small size.

1.
We saw some projects of reference on other teams, They have used a nas storage have 5G bandwidth with ethernet.
Is there official solution for the nas to store recorded data with drivepx2?

2.
I know that drivepx2 have two processor can store recorded data.
How do I use two processors to sync and record data from sensors such as cameras, riders, GPS, and vehicles?

#3
Posted 01/02/2018 05:22 AM   
You are right about the limitations with the FAQ I provided. At most, the USB storage on a single Tegra can record a maximum of 3 cameras generating RAW at 30 frames per second. Here are your options for recording 12 RAW cameras: [b]Option 1: Single DPX with reduced framerate[/b] [olist] [.]On Tegra A, attach 6 cameras and mount one USB drive.[/.] [.]Do the same on Tegra B.[/.] [.]For each camera, reduce the framerate to 15 or so frames per second.[/.] [.]Use PTP or gPTP to synchronize the camera timestamps.[/.] [/olist] [b]Option 2: Two DPXs[/b] [olist] [.]For each DPX, attach 3 cameras to each Tegra and mount one USB drive to each Tegra. That gives 4 Tegras * 3 cameras per Tegra.[/.] [.]Use PTP or gPTP to synchronize the camera timestamps.[/.] [/olist] The 0.6.54 DriveWorks release notes contain guidance on using PTP/gPTP. I don't know about other NVIDIA teams having 5G bandwidth with ethernet.
You are right about the limitations with the FAQ I provided. At most, the USB storage on a single Tegra can record a maximum of 3 cameras generating RAW at 30 frames per second.
Here are your options for recording 12 RAW cameras:

Option 1: Single DPX with reduced framerate
  1. On Tegra A, attach 6 cameras and mount one USB drive.
  2. Do the same on Tegra B.
  3. For each camera, reduce the framerate to 15 or so frames per second.
  4. Use PTP or gPTP to synchronize the camera timestamps.



Option 2: Two DPXs
  1. For each DPX, attach 3 cameras to each Tegra and mount one USB drive to each Tegra. That gives 4 Tegras * 3 cameras per Tegra.
  2. Use PTP or gPTP to synchronize the camera timestamps.


The 0.6.54 DriveWorks release notes contain guidance on using PTP/gPTP.

I don't know about other NVIDIA teams having 5G bandwidth with ethernet.

#4
Posted 01/03/2018 10:58 PM   
Hey Groot. If you choose to record with multiple Tegras, you will need to modify your JSON config file with currently undocumented attributes. I've added a new section to the Data Logging FAQ that should be helpful. The new section is [i]How do I modify my JSON config file for distributed recording?[/i]. https://devtalk.nvidia.com/default/topic/1007100/faq/data-logging/ Also, if you choose to reduce your camera framerates, the "Data Acquisition" chapter of [i]DriveWorks Development Guide[/i] explains how to do that. In particular, see "Recording at a Framerate Other Than 30 FPS".
Hey Groot. If you choose to record with multiple Tegras, you will need to modify your JSON config file with currently undocumented attributes. I've added a new section to the Data Logging FAQ that should be helpful.
The new section is How do I modify my JSON config file for distributed recording?.
https://devtalk.nvidia.com/default/topic/1007100/faq/data-logging/


Also, if you choose to reduce your camera framerates, the "Data Acquisition" chapter of DriveWorks Development Guide explains how to do that. In particular, see "Recording at a Framerate Other Than 30 FPS".

#5
Posted 01/05/2018 10:36 PM   
Scroll To Top

Add Reply