tensorrt

Hello AI World guide to deploying deep-learning inference networks and deep vision primitives with TensorRT and NVIDIA Jetson.

TensorRT is a C++ library for high performance inference on NVIDIA GPUs and deep learning accelerators.

PyTorch ,ONNX and TensorRT implementation of YOLOv4

TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is distinguished by several outstanding features, including its cross-platform capability, high performance, model compression and code pruning. Based on ncnn and Rapidnet, TNN further strengthens the support and performance optimization for mobile devices, and also draws on the advantages of good extensibility and high performance from existed open source efforts. TNN has been deployed in multiple Apps from Tencent, such as Mobile QQ, Weishi, Pitu, etc. Contributions are welcome to work in collaborative with us and make TNN a better framework.

Implementation of popular deep learning networks with TensorRT network definition API

An easy to use PyTorch to TensorRT converter

Deep Learning API and Server in C++14 support for Caffe, Caffe2, PyTorch,TensorRT, Dlib, NCNN, Tensorflow, XGBoost and TSNE

YOLOv4, YOLOv4-tiny, YOLOv3, YOLOv3-tiny Implemented in Tensorflow 2.0, Android. Convert YOLO v4 .weights tensorflow, tensorrt and tflite

Deep learning gateway on Raspberry Pi and other edge devices

micronet, a model compression and deploy lib. compression: 1、quantization: quantization-aware-training(QAT), High-Bit(>2b)(DoReFa/Quantization and Training of Neural Networks for Efficient Integer-Arithmetic-Only Inference)、Low-Bit(≤2b)/Ternary and Binary(TWN/BNN/XNOR-Net); post-training-quantization(PTQ), 8-bit(tensorrt); 2、 pruning: normal、regular and group convolutional channel pruning; 3、 group convolution structure; 4、batch-normalization fuse for quantization. deploy: tensorrt, fp32/fp16/int8(ptq-calibration)、op-adapt(upsample)、dynamic_shape

TensorRT MODNet, YOLOv4, YOLOv3, SSD, MTCNN, and GoogLeNet

HyperPose: A Python/C++ Library for Fast and Flexible Human Pose Estimation

Add bisenetv2. My implementation of BiSeNet

Fast and accurate object detection with end-to-end GPU optimization

High-performance multiple object tracking based on YOLO, Deep SORT, and KLT 🚀

TensorFlow models accelerated with NVIDIA TensorRT

Real-time pose estimation accelerated with NVIDIA TensorRT

This repo is implemented based on detectron2 and centernet

TensorRT for Yolov3

A simple, efficient, easy-to-use Nvidia TensorRT wrapper for CNN, support c++ and python.

[ICLR 2020] "FasterSeg: Searching for Faster Real-time Semantic Segmentation" by Wuyang Chen, Xinyu Gong, Xianming Liu, Qian Zhang, Yuan Li, Zhangyang Wang

Image classification with NVIDIA TensorRT from TensorFlow models.

Adlik: Toolkit for Accelerating Deep Learning Inference

A library for high performance deep learning inference on NVIDIA GPUs.

TensorRT-7 Network Lib 包括常用目标检测、关键点检测、人脸检测、OCR等 可训练自己数据

convert mmdetection model to tensorrt, support fp16, int8, batch input, dynamic shape etc.

YOLOv3 implementation in TensorFlow 2.3.1