Is “Tensor RT Cross Compile for Linux” for TensorRT 5.1 avialable for Jetson Xavier?
With the latest (0.9.14) SDK Manager I can only download “TensorRT on Target” for version 5.1 in Jetpack 4.2.1.
It would be nice to have cross compile support, like in the Drive AGX Developer Kit, where “Tensor RT Cross Compile for Linux” package is available in the SDK Manager among the host components (but only for version 5.0)
When I choose “DRIVE” Product category and “Host Machine” configuration in step 01, there is a “Host Components → AI → TensorRT Cross Compile for LINUX” version 5.0 package in step 02:
[url]https://imgur.com/2xnOi8q[/url]
However, when I choose “Jetson” Product category and Host Machine configuration in step 01, there is no “Host Components → AI → TensorRT Cross Compile for LINUX” package included in the list in step 02:
[url]https://imgur.com/4BmYd2v[/url]
Under “Host Components → CUDA” there is no TensorRT related package, so I my guess is that it is not included in this case. Am I overlooking something?
After installing all selectable host packages / toolchains using SDK Manager for the Jetson TX2 (but skipping the flashing process of the TX2), I still don’t see TensorRT specific tools like graphsurgeon-tf anywhere on my system.
Moreover, I should expect to see static libs like libnvinfer_static.a somewhere to link against but doing either a find / -iname "nvinfer or dpkg -l | grep nvinfer shows up nothing.
Thanks for the reply, but I think it’s still rather vague - exactly which src/header/library files do we need for both TensorRT and DeepStream? Moreover, these could change from version to version and it’s more reassuring if the cross compilation env could be a bit less brittle.
At the moment, I’ve downloaded and installed the x86 TensorRT and DeepStream packages manually just so I have the required tools like graphsurgeon and uff-convert to run on my host, and I’m serving the entire /usr folder from the TX2 with NFS just so I can compile TensorRT apps for TX2. Quite adhoc and hardly an optimal process.
Is it possible for you guys to make a proper release of an aarch64 cross-compile .deb for TensorRT and DeepStream (and for other relevant NVIDIA products) on the host? Otherwise, cross-compilation seems to be a bit of an after-thought.
There are some alternative. Would you mind to check if these are suitable for you?
1. You can use the remote compiling option in the Nsight.
This will compile the application directly on the target and you don’t need to handle the libraries issue.
Can you clarify your comment about NSight? I’m not sure how NSight is relevant to cross compiling TensorRT and DeepStream applications for Xavier / TX2.
You mean running the deepstream-l4t container on the Xavier / TX2 target and compiling on target instead of host? Not quite sure what you mean here as well.
Just so we’re both on the same page, this thread was about cross-compiling on host for Xavier / TX2 targets. You have the cross compile headers and binaries for gcc and cuda toolchain packaged in SDKManager, but no aarch64 libs for TensorRT and DeepStream to actually build apps on host for target.
If anyone is actually following up, even the CUDA cross-compile toolkit that the SDK Manager installs is incomplete.
There is also no aarch64 cross-compile libs for CUDNN and CUBLAS anywhere after installing the host cross compile toolchain using SDK Manager. But the worst thing is that NVIDIA does not seem to host those aarch64-linux-gnu packages in any of the public URLs that I can find, so I can’t even manually download and install these…
Do you meet any problem when installing CUDA toolkit for host with JetPack installer.
If yes, please let us know.
As mentioned above, to cross compiling a deepstream app on the host requires you to prepare all the package back to the host.
We don’t have a pre-collected package for Jetson user currently.
This request is updated to our internal team and will be prioritized internally.
More, to compile an application directly on the target with Nsight.
You can choose the “remote” option when pressing the compiling button.
Nsight will automatically sync up your project to the target and compile it directly the Jetson.
I also have the requirement of the tool package for cross compiling and debugging for jetson nano development by using X86-64 platform. When Nvidia plans to release the tools?