compression

Compress tool outputs, logs, files, and RAG chunks before they reach the LLM. 20% fewer tokens for coding agents, 60-95% fewer tokens for JSON, same answers. Library, proxy, MCP server.

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

Deduplicating archiver with compression and authenticated encryption.

Easy-to-use and powerful LLM and SLM library with awesome model zoo.

State-of-the-art LLM compression, built for production inference with vLLM

[ICML'26] SimpleMem: Efficient Lifelong Memory for LLM Agents — Text & Multimodal

Insane(ly slow but wicked good) PNG image optimization

AIMET is a library that provides advanced quantization and compression techniques for trained neural network models.

Extract files from any kind of container formats

A curated list for Efficient Large Language Models

A PyTorch library and evaluation platform for end-to-end compression research

PaddleSlim is an open-source library for deep model compression and architecture search.

A toolkit to optimize ML models for deployment for Keras and TensorFlow, including quantization and pruning.

Access large archives as a filesystem efficiently, e.g., TAR, RAR, ZIP, GZ, BZ2, XZ, ZSTD archives

Code for CRATE (Coding RAte reduction TransformEr).

Neural Network Compression Framework for enhanced OpenVINO™ inference

[NeurIPS 2023] LLM-Pruner: On the Structural Pruning of Large Language Models. Support Llama-3/3.1, Llama-2, LLaMA, BLOOM, Vicuna, Baichuan, TinyLlama, etc.

[CVPR 2020] GAN Compression: Efficient Architectures for Interactive Conditional GANs

PyTorch Implementation of "Lossless Image Compression through Super-Resolution"

a free local self hosted video compressor webui designed for performance and ease of use. inspired by 8mb.video