Package profile

crfm-helm

Summary: Benchmark for language models
Author: Stanford CRFM <contact-crfm@stanford.edu>
Homepage: https://github.com/stanford-crfm/helm
Source: https://github.com/stanford-crfm/helm (Repo profile)
Number of releases: 17
First release: 0.1.0 on 2022-11-17
Latest release: 0.5.8 on 2025-08-30

Releases

PyPI Downloads

Loading PyPI statistics...

Dependencies

Crfm-helm has 133 dependencies, 108 of which optional.

Dependencies of crfm-helm (133).
Dependency	Optional
bottle	false
cattrs	false
colorlog	false
dacite	false
datasets	false
importlib-resources	false
Mako	false
nltk	false
numpy	false
pandas	false
pyarrow	false
pyarrow-hotfix	false
pyhocon	false
retrying	false
rouge-score	false
scikit-learn	false
scipy	false
spacy	false
sqlitedict	false
torch	false
torchvision	false
tqdm	false
transformers	false
uncertainty-calibration	false
zstandard	false
accelerate	true
ai2-olmo	true
aleph-alpha-client	true
anthropic	true
autokeras	true
av	true
awscli	true
bert_score	true
bert-score	true
black	true
boto3	true
botocore	true
clang	true
clip-anytorch	true
cohere	true
colorcet	true
diffusers	true
einops	true
einops-exts	true
evaluate	true
fairlearn	true
ffmpeg-python	true
flake8	true
flash-attn	true
flax	true
ftfy	true
gdown	true
google-api-python-client	true
google-cloud-aiplatform	true
google-cloud-storage	true
google-cloud-translate	true
gradio_client	true
gunicorn	true
html2text	true
httpx	true
ibm-watsonx-ai	true
icetk	true
imagehash	true
immutabledict	true
jax	true
jaxlib	true
jieba	true
jiwer	true
langdetect	true
latex	true
Levenshtein	true
librosa	true
lpips	true
lxml	true
matplotlib	true
mistralai	true
multilingual-clip	true
mypy	true
NudeNet	true
numba	true
omegaconf	true
open-clip-torch	true
openai	true
openai-whisper	true
opencc	true
opencv-python	true
opencv-python-headless	true
openpyxl	true
pdf2image	true
pillow	true
pre-commit	true
pycocoevalcap	true
pydantic	true
pydub	true
pymongo	true
pyonmttok	true
pypinyin	true
pytest	true
pythainlp	true
python-crfsuite	true
python-docx	true
pytorch-fid	true
pytorch-lightning	true
pytrec_eval	true
qwen-vl-utils	true
rapidfuzz	true
reka-api	true
sacrebleu	true
scaleapi	true
scikit-image	true
seaborn	true
selenium	true
sentence_transformers	true
sentencepiece	true
simple-slurm	true
soundfile	true
summ-eval	true
surge-api	true
tensorflow	true
tiktoken	true
timm	true
together	true
tokenizers	true
torch-fidelity	true
torchmetrics	true
transformers_stream_generator	true
unidecode	true
Unidecode	true
wandb	true
websocket-client	true
writerai	true
xdoctest	true
xlrd	true

Package profile

crfm-helm

Releases

Release table

PyPI Downloads

Dependencies

Details

Project URLs

Dependencies

Package description