[Unmaintained, see README] An ecosystem of Rust libraries for working with large language models

Awesome Pretrained Chinese NLP Models，高质量中文预训练模型&大模型&多模态模型&大语言模型集合

A relatively basic implementation of RWKV in Rust written by someone with very little math and ML knowledge. Supports 32, 8 and 4 bit evaluation. It can also directly load PyTorch RWKV models.

GGML bindings that aim to be idiomatic Rust rather than directly corresponding to the C/C++ interface

Bleeding edge low level Rust binding for GGML

LLM inference in C/C++

Some random tools for working with the GGUF file format