PySpect

Home

Lists

Top stars

Rising stars

← Back to lm-eval

Dependencies for lm-eval

Frequently asked questions

© 2025-2026 PySpect

Dependencies of lm-eval (72).
Dependency	Optional	Group
datasets	false
dill	false
evaluate	false
jinja2	false
more_itertools	false
numpy	false
pytablewriter	false
rouge-score	false
sacrebleu	false
scikit-learn	false
sqlitedict	false
tqdm	false
typing_extensions	false
word2number	false
accelerate	true	hf
aiohttp	true	api
antlr4-python3-runtime	true	math
auto-gptq	true	gptq
emoji	true	japanese-leaderboard
fugashi	true	japanese-leaderboard
fuzzywuzzy	true	longbench
gptqmodel	true	gptqmodel
ibm_watsonx_ai	true	ibm-watsonx-ai
immutabledict	true	ifeval
jieba	true	longbench
jsonlines	true	archiver
kstar-planner	true	acpbench
langdetect	true	ifeval
lark	true	acpbench
librosa	true	audiolm-qwen
litellm	true	litellm
lm_eval	true	tasks
math_verify	true	math
nagisa	true	multilingual
neologdn	true	japanese-leaderboard
nltk	true	ifeval
onnxruntime	true	onnxruntime
onnxruntime-genai	true	onnxruntime-genai
optimum	true	optimum
optimum-habana	true	habana
optimum-intel	true	ipex
pandas	true	wandb
pddl	true	acpbench
peft	true	hf
pillow	true	dev
pycountry	true	multilingual
pymorphy2	true	libra
pytest	true	dev
pytest-cov	true	dev
pytest-xdist	true	dev
python-dotenv	true	ibm-watsonx-ai
requests	true	api
rouge	true	longbench
rouge_score	true	japanese-leaderboard
scipy	true	ruler
sentencepiece	true	dev
soundfile	true	audiolm-qwen
sparsify	true	sparsify
statsmodels	true	discrim-eval
sympy	true	math
tarski	true	acpbench
tenacity	true	api
tiktoken	true	api
torch	true	hf
trackio	true	trackio
transformers	true	hf
unitxt	true	unitxt
vllm	true	vllm
wandb	true	wandb
wonderwords	true	ruler
zeno-client	true	zeno
zstandard	true	archiver