Package profile
lighteval
- Summary: A lightweight and configurable evaluation package
- Author: Nathan Habib <nathan.habib@huggingface.com>, Clémentine Fourrier <clementine@huggingface.com>, Thomas Wolf <thom@huggingface.com>
- Homepage: https://github.com/huggingface/lighteval
- Source: https://github.com/huggingface/lighteval (Repo profile)
- Number of releases: 17
- First release: 0.0.1 on 2023-10-19
- Latest release: 0.10.0 on 2025-05-22
Releases
PyPI Downloads
Dependencies
Lighteval has 51 dependencies, 27 of which optional.| Dependency | Optional |
|---|---|
| accelerate | false |
| aenum | false |
| colorlog | false |
| datasets | false |
| fsspec | false |
| GitPython | false |
| httpx | false |
| huggingface_hub | false |
| latex2sympy2_extended | false |
| nltk | false |
| numpy | false |
| protobuf | false |
| pycountry | false |
| pydantic | false |
| pytablewriter | false |
| rich | false |
| rouge_score | false |
| sacrebleu | false |
| scikit-learn | false |
| sentencepiece | false |
| termcolor | false |
| torch | false |
| transformers | false |
| typer | false |
| auto-gptq | true |
| bitsandbytes | true |
| deepdiff | true |
| diskcache | true |
| hf-doc-builder | true |
| jieba | true |
| langdetect | true |
| litellm | true |
| more_itertools | true |
| nanotron | true |
| openai | true |
| optimum | true |
| peft | true |
| pre-commit | true |
| pytest | true |
| pyvi | true |
| ray | true |
| ruff | true |
| s3fs | true |
| spacy | true |
| stanza | true |
| tensorboardX | true |
| text-generation | true |
| tiktoken | true |
| vllm | true |
| wandb | true |
| watchdog | true |