TensorRT Samples

Contents

1. "Hello World" Samples

Sample	Language	Format	Description
sampleOnnxMNIST	C++	ONNX	“Hello World” For TensorRT With ONNX
sampleMNIST	C++	Caffe	“Hello World” For TensorRT Using Caffe
end_to_end_tensorflow_mnist	Python	UFF	“Hello World” For TensorRT Using TensorFlow
network_api_pytorch_mnist	Python	INetwork	“Hello World” For TensorRT Using Pytorch

2. TensorRT API Samples

Sample	Language	Format	Description
sampleAlgorithmSelector	C++	Caffe	Algorithm Selection API usage
sampleCharRNN	C++	INetwork	Building An RNN Network Layer By Layer
sampleDynamicReshape	C++	ONNX	Digit Recognition With Dynamic Shapes In TensorRT
sampleINT8	C++	Caffe	Performing Inference In INT8 Using Custom Calibration
sampleINT8API	C++	Caffe	Performing Inference In INT8 Precision
sampleMNISTAPI	C++	INetwork	Building a Simple MNIST Network Layer by Layer
sampleOnnxMnistCoordConvAC	C++	ONNX	Implementing CoordConv with a custom plugin
sampleIOFormats	C++	Caffe	Specifying TensorRT I/O Formats
sampleUffMNIST	C++	UFF	Import A TensorFlow Model And Run Inference
sampleUffPluginV2Ext	C++	UFF	Adding A Custom Layer That Supports INT8 I/O To Your Network
trtexec	C++	All	TensorRT Command-Line Wrapper: trtexec
engine_refit_mnist	Python	INetwork	Refitting A TensorRT Engine
int8_caffe_mnist	Python	Caffe	INT8 Calibration
introductory_parser_samples	Python	Any	Introduction To Importing Models Using TensorRT Parsers
onnx_packnet	Python	ONNX	TensorRT Inference Of ONNX Models With Custom Layers
uff_custom_plugin	Python	INetwork	Adding A Custom Layer To Your TensorFlow Network In TensorRT

3. Application Samples

Sample	Language	Format	Description
sampleFasterRCNN	C++	Caffe	Object Detection With Faster R-CNN
sampleUffFasterRCNN	C++	UFF	Object Detection With A TensorFlow FasterRCNN Network
sampleGoogleNet	C++	Caffe	Building And Running GoogleNet In TensorRT
sampleSSD	C++	Caffe	Object Detection With SSD
sampleUffSSD	C++	UFF	Object Detection With A TensorFlow SSD Network
sampleUffMaskRCNN	C++	UFF	Object Detection And Instance Segmentation With MasK R-CNN Network
efficientdet	Python	ONNX	EfficientDet Object Detection with TensorRT
efficientnet	Python	ONNX	EfficientNet V1 and V2 Classification with TensorRT
tensorflow_object_detection_api	Python	ONNX	TensorFlow Object Detection API Models in TensorRT
uff_ssd	Python	UFF	Object Detection with SSD
yolov3_onnx	Python	ONNX	Object Detection Using YOLOv3 With TensorRT ONNX Backend

Known Limitations

• UFF converter and GraphSurgeon tools are only supported with Tensorflow 1.x
• For the UFF samples, please use the NVIDIA tf1 (Tensorflow 1.x) for running these tests or install Tensorflow 1.x manually.