TensorRT

Topic	Replies	Views	Activity
TensorRT 8.2 and Framework Integrations are out now! tensorrt The latest release of TensorRT, 8.2 GA, and TensorRT Integrations for PyTorch and TensorFlow, is now available for download. Highlight includes: TensorRT 8.2 Optimizations for T5 and GPT-2 deliver real time translati…	5	5338	November 6, 2023
Best practices for reporting an issue or bug relating to TensorRT	0	8447	September 21, 2018
You have exhausted the lab time provided with your course enrollment deep-learning	0	14	April 28, 2024
Bug : Tensorrt Model not loading on same GPU on a different device (slight driver version difference) tensorrt , cudnn	0	38	April 26, 2024
What is "Interactivity per User Tokens per Second" mentioned in Jensen's GTC 2024 talk	3	198	April 26, 2024
Unsupported SM: 0x601 cudnn	2	151	April 25, 2024
Implicitly data-dependent shape and explicitly data-dependent shape	0	43	April 25, 2024
Pip Installation Error with pytorch-quantization	9	2842	April 25, 2024
Latest TensorRT release tensorrt	4	348	April 23, 2024
This TensorFlow binary is optimized to use available CPU instructions in performance-critical operations. To enable the following instructions: FMA, i tensorrt , tensorflow , cudnn	0	112	April 22, 2024
Post processing logic for TensorRT Peoplenet in Python tensorrt , cuda	10	454	April 22, 2024
deserializeCudaEngine failed. Serialization assertion magicTagRead == kMAGIC_TAG failed.Magic tag does not match	4	1994	April 22, 2024
Jetpack 6 \| tensorflow model \| Object detection \| inference \| Jetson orin nano module cudnn	0	66	April 21, 2024
PyTorch usage of INMSLayer on TensorRT pytorch	2	367	April 19, 2024
The engine plan file is generated on an incompatible device expecting compute 6.1 got compute 8.6,please rebuild	3	1329	April 19, 2024
Convert onnx to engine failed by using trtexec, stack overflow; cudnn	0	69	April 19, 2024
TensorRT --- non-int8 fallback when trying to calibrate ONNX model tensorrt , deepstream	0	112	April 17, 2024
TensorRT engine cannot be safely deleted in deconstruction of a global or static instance tensorrt	4	462	April 18, 2024
Error reading serialized TensorRT engine tensorrt , cuda , ubuntu , cudnn , computer-vision	1	105	April 18, 2024
TensorRT V10 inference using context.execute_async_v3()	1	108	April 17, 2024
How to correctly set up bindings for execute_async_v3()? tensorrt	1	97	April 17, 2024
TRT FIle	0	98	April 16, 2024
Arduino Nano (USB) -- Jetson Xavier NX kernel , usb , arduino	0	76	April 16, 2024
How to run a neural network on DLA only in Jetson devices? tensorrt , dla	0	76	April 16, 2024
Unable to claim the course certificate deep-learning	3	106	April 15, 2024
Issue with TensorRT Whisper consuming inordinate amount of system memory which kills the process tensorrt , cuda , pytorch , cudnn	0	89	April 15, 2024
Onnx to tensorrt problem	1	108	April 15, 2024
Tensorrt Threads affect each other during multithreaded inference tensorrt	15	972	April 15, 2024
Fundamentals of Deep Learning - Accidentally clicked on 'assess task'	2	127	April 12, 2024
Something wrong the rstp stream deepstream analysis cudnn , deepstream	2	123	April 11, 2024

TensorRT 8.2 and Framework Integrations are out now!

tensorrt

The latest release of TensorRT, 8.2 GA, and TensorRT Integrations for PyTorch and TensorFlow, is now available for download. Highlight includes: TensorRT 8.2 Optimizations for T5 and GPT-2 deliver real time translati…