Development repository for the Triton language and compiler

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

A guidance language for controlling large language models.

Structured Outputs

A high-throughput and memory-efficient inference and serving engine for LLMs

Inference Llama 2 in one file of pure C

Instruction Tuning with GPT-4

High-performance In-browser LLM Inference Engine

An official codebase for paper ":champagne: CHAMPAGNE: Learning Real-world Conversation from Large-Scale Web Videos (ICCV 23)"

KoAlpaca: 한국어 명령어를 이해하는 오픈소스 언어모델 (KoAlpaca: An open-source language model to understand Korean instructions)

Instruct-tune LLaMA on consumer hardware

Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM

A modular RL library to fine-tune language models to human preferences

A Python library that generates static type annotations by collecting runtime types

Uplift modeling and causal inference with machine learning algorithms

This repository contains code for the paper "Meet Your Favorite Character: Open-domain Chatbot Mimicking Fictional Characters with only a Few Utterances", published at NAACL' 2022

MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.

A dataset for pretraining language models targeted for legal tasks.

Memray is a memory profiler for Python

Official code from the paper "Offline RL for Natural Language Generation with Implicit Language Q Learning"

Official repository for "SimpleTOD: A Simple Language Model for Task-Oriented Dialogue"

Playwright is a framework for Web Testing and Automation. It allows testing Chromium, Firefox and WebKit with a single API.

Tevatron - Unified Document Retrieval Toolkit across Scale, Language, and Modality. Demo in SIGIR 2023, SIGIR 2025.

Powering AWS purpose-built machine learning chips. Blazing fast and cost effective, natively integrated into PyTorch and TensorFlow and integrated with your favorite AWS services

A library for creating directed graph editors

Original Implementation of Prompt Tuning from Lester, et al, 2021

A Unified Library for Parameter-Efficient and Modular Transfer Learning

💬 Open source machine learning framework to automate text- and voice-based conversations: NLU, dialogue management, connect to Slack, Facebook, and more - Create chatbots and voice assistants

Magnificent app which corrects your previous console command.

Package to compute Mauve, a similarity score between neural text and human text. Install with `pip install mauve-text`.