Post-training with Tinker

LLM training in simple, raw C/CUDA

Minimal, clean code for the Byte Pair Encoding (BPE) algorithm commonly used in LLM tokenization.

Large Language Model Text Generation Inference

A high-throughput and memory-efficient inference and serving engine for LLMs

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Simple and efficient pytorch-native transformer text generation in <1000 LOC of python.

Ongoing research training transformer models at scale

Inference Llama 2 in one file of pure C

🦦 Otter, a multi-modal model based on OpenFlamingo (open-sourced version of DeepMind's Flamingo), trained on MIMIC-IT and showcasing improved instruction-following and in-context learning ability.

Audiocraft is a library for audio processing and generation with deep learning. It features the state-of-the-art EnCodec audio compressor / tokenizer, along with MusicGen, a simple and controllable…

OccNet: Scene as Occupancy