Web UI for ExLlamaV2

A fast inference library for running LLMs locally on modern consumer-class GPUs

Human-friendly framework to test and evaluate LLMs, RAGs and ChatBots.

Code for the paper "Evaluating Large Language Models Trained on Code"

ReservedCpuSets is an extension of the SetRTCores feature of WindowsIoT CSP