Popular repositories Loading

1. juryeval juryeval Public

   Lightweight NLP/LLM evaluation toolkit — metrics, LLM-as-Judge, significance testing, prompt robustness, and CLI

   Python

2. lm-evaluation-harness lm-evaluation-harness Public

   Forked from EleutherAI/lm-evaluation-harness

   A framework for few-shot evaluation of language models.

   Python

3. deepeval deepeval Public

   Forked from confident-ai/deepeval

   The LLM Evaluation Framework

   Python

4. lighteval lighteval Public

   Forked from huggingface/lighteval

   Lighteval is your all-in-one toolkit for evaluating LLMs across multiple backends

   Python

5. opencompass opencompass Public

   Forked from open-compass/opencompass

   OpenCompass is an LLM evaluation platform, supporting a wide range of models (Llama3, Mistral, InternLM2,GPT-4,LLaMa2, Qwen,GLM, Claude, etc) over 100+ datasets.

   Python

6. ragas ragas Public

   Forked from vibrantlabsai/ragas

   Supercharge Your LLM Application Evaluations 🚀

   Python