Skip to content
#

black-box-benchmarking

Star

Here are 7 public repositories matching this topic...

Language: All
Filter by language
All 7 Python 3 Go 1 Java 1 Jupyter Notebook 1 Rust 1

Eustema-S-p-A / SCARF

Star 5

SCARF (System for Comprehensive Assessment of RAG Frameworks) is a modular evaluation framework for benchmarking deployed Retrieval Augmented Generation (RAG) applications. It offers end-to-end, black-box assessment across multiple configurations, supports automated testing with several vector databases and LLMs.

python nlp open-source benchmarking machine-learning ai research-tool evaluation-framework rag black-box-benchmarking llm
  • Updated Apr 17, 2025
  • Python

thomasWeise / BBDOB_W_Model

Star 4

The W-Model, a tunable Black-Box Discrete Optimization Benchmarking (BB-DOB) problem, implemented for the BB-DOB@GECCO Workshop.

benchmark discrete-mathematics noise local-search experiments epistasis evolutionary-algorithm multi-objective deterministic random-walk fitness-landscape combinatorial-optimization neutrality black-box-benchmarking non-separability multi-objectivity ruggedness benchmark-problem hill-climber
  • Updated Oct 14, 2020
  • Java

Improve this page

Add a description, image, and links to the black-box-benchmarking topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the black-box-benchmarking topic, visit your repo's landing page and select "manage topics."

Learn more