GPUDirect RDMA on Jetson TX1?

Autonomous Machines Jetson & Embedded Systems Jetson TX1
1

According to: [url]http://docs.nvidia.com/cuda/gpudirect-rdma/[/url] GPUDirect RDMA is available on both Tesla and Quadro GPUs.

Is GPUDirect RDMA possible on Jetson TX1?

2

I’ve never used GPUDirect before, but from that URL’s description it isn’t possible for a JTX1 (or a JTK1) to work with GPUDirect. The problem is that on a Jetson the GPU is not connected via the PCIe bus, it’s connected directly to the memory controller instead. Though there is a PCIe bus, no PCIe features will ever touch the GPU, and GPUDirect depends on PCI features.

3

Thanks for your reply! I am working on creating a PCIe connection between the Jetson TX1 and an Altera Cyclone V GT FPGA Development board. Even though the RDMA will not work it should be possible to get PCIe connection to work according to [url]https://devtalk.nvidia.com/default/topic/939528/?comment=4897557[/url]

4

The analog to GPUDirect on integrated Tegra is CUDA ZeroCopy memory. On Tegra this is where the CPU and GPU are mapped to the same memory and can be accessed without memory copies. See here for an example - [url]http://arrayfire.com/zero-copy-on-tegra-k1/[/url]

If possible, you will want your FPGA to DMA to the same ZeroCopy memory that the GPU has access to.

5

Thanks for your reply! Sounds as a good approach

6

[deleted]