Tensorflow with TensorRT on Jetson TX2

Autonomous Machines Jetson & Embedded Systems Jetson TX2
1

Hello All,

I am new to jetson platform.
I followed this documentation Installing TensorFlow for Jetson Platform :: NVIDIA Deep Learning Frameworks Documentation to install tensorflow on jetson. Will this install tensorflow with tensorRT support.

(or)

Should I follow this documentation GitHub - NVIDIA-AI-IOT/tf_trt_models: TensorFlow models accelerated with NVIDIA TensorRT to install tensorflow with tensorRT

Thanks…

2

Hi,

YES. The release includes TensorRT support.

Please noticed that there are two possible way to execute TensorRT.

1.TFTRT:
Execute TensorRT within TensorFlow frameworks.
The process is pretty easy but there are some performance overhead from TensorFlow.
[url]https://github.com/NVIDIA-AI-IOT/tf_trt_models[/url]

2. Pure Tensorrt:
It can maximize the inference performance on Jetson but it’s more complicated to use.
[url]https://github.com/NVIDIA-AI-IOT/tf_to_trt_image_classification[/url]

Thanks.