Package profile

crfm-helm

Summary: Benchmark for language models
Author: Stanford CRFM
Homepage: https://github.com/stanford-crfm/helm
Source: https://github.com/stanford-crfm/helm (Repo profile)
Number of releases: 15
First release: 0.1.0 on 2022-11-17
Latest release: 0.5.6 on 2025-06-20

Releases

PyPI Downloads

Dependencies

Crfm-helm has 131 dependencies, 106 of which optional.

Dependencies of crfm-helm (131).
Dependency	Optional
bottle	false
cattrs	false
colorlog	false
dacite	false
datasets	false
importlib-resources	false
Mako	false
nltk	false
numpy	false
pandas	false
pyarrow	false
pyarrow-hotfix	false
pyhocon	false
retrying	false
rouge-score	false
scikit-learn	false
scipy	false
spacy	false
sqlitedict	false
torch	false
torchvision	false
tqdm	false
transformers	false
uncertainty-calibration	false
zstandard	false
accelerate	true
ai2-olmo	true
aleph-alpha-client	true
anthropic	true
autokeras	true
av	true
awscli	true
bert_score	true
bert-score	true
black	true
boto3	true
botocore	true
clip-anytorch	true
cohere	true
colorcet	true
diffusers	true
einops	true
einops-exts	true
evaluate	true
fairlearn	true
ffmpeg-python	true
flake8	true
flash-attn	true
flax	true
ftfy	true
gdown	true
google-api-python-client	true
google-cloud-aiplatform	true
google-cloud-storage	true
google-cloud-translate	true
gradio_client	true
gunicorn	true
html2text	true
httpx	true
ibm-watsonx-ai	true
icetk	true
imagehash	true
immutabledict	true
jax	true
jaxlib	true
jieba	true
jiwer	true
langchain	true
langchain-community	true
langdetect	true
latex	true
librosa	true
lpips	true
lxml	true
matplotlib	true
mistralai	true
multilingual-clip	true
mypy	true
NudeNet	true
numba	true
omegaconf	true
open-clip-torch	true
openai	true
openai-whisper	true
opencc	true
opencv-python	true
openpyxl	true
pdf2image	true
pillow	true
pre-commit	true
pycocoevalcap	true
pydantic	true
pydub	true
pymongo	true
pyonmttok	true
pypinyin	true
pytest	true
pythainlp	true
python-crfsuite	true
python-docx	true
pytorch-fid	true
pytorch-lightning	true
pytrec_eval	true
qwen-vl-utils	true
rapidfuzz	true
reka-api	true
sacrebleu	true
scaleapi	true
scikit-image	true
seaborn	true
selenium	true
sentencepiece	true
simple-slurm	true
soundfile	true
summ-eval	true
surge-api	true
sympy	true
tensorflow	true
tiktoken	true
timm	true
together	true
tokenizers	true
torch-fidelity	true
torchmetrics	true
transformers_stream_generator	true
unidecode	true
Unidecode	true
wandb	true
websocket-client	true
writerai	true
xlrd	true

Package profile

crfm-helm

Releases

Release table

PyPI Downloads

Dependencies

Details

Project URLs

Dependencies

Package description