Example 📓 Jupyter notebooks that demonstrate how to build, train, and deploy machine learning models using 🧠 Amazon SageMaker.

Cross-platform, customizable ML solutions for live and streaming media.

A high-throughput and memory-efficient inference and serving engine for LLMs

Making large AI models cheaper, faster and more accessible

ncnn is a high-performance neural network inference framework optimized for the mobile platform

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Port of OpenAI's Whisper model in C/C++

Hello AI World guide to deploying deep-learning inference networks and deep vision primitives with TensorRT and NVIDIA Jetson.

OpenVINO™ is an open-source toolkit for optimizing and deploying AI inference

NVIDIA® TensorRT™ is an SDK for high-performance deep learning inference on NVIDIA GPUs. This repository contains the open source components of TensorRT.

💎1MB lightweight face detection model (1MB轻量级人脸检测模型)

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

Pre-trained Deep Learning models and demos (high quality and extremely fast)

Adversarial Robustness Toolbox (ART) - Python Library for Machine Learning Security - Evasion, Poisoning, Extraction, Inference - Red and Blue Teams

Large Language Model Text Generation Inference

Faster Whisper transcription with CTranslate2

📚 Jupyter notebook tutorials for OpenVINO™

TNN: developed by Tencent Youtu Lab and Guangying Lab, a uniform deep learning inference framework for mobile、desktop and server. TNN is distinguished by several outstanding features, including its cross-platform capability, high performance, model compression and code pruning. Based on ncnn and Rapidnet, TNN further strengthens the support and …

Python Library for learning (Structure and Parameter), inference (Probabilistic and Causal), and simulations in Bayesian Networks.

TensorFlow template application for deep learning