Package profile
ai2-olmo-eval
- Summary: In-loop evaluation tasks for language modeling
- Author: Allen Institute for Artificial Intelligence <olmo@allenai.org>
- Homepage: https://github.com/allenai/OLMo-in-loop-evals
- Source: https://github.com/allenai/OLMo-in-loop-evals (Repo profile)
- Number of releases: 14
- First release: 0.1.0 on 2024-10-28
- Latest release: 0.8.4 on 2025-06-05
Releases
PyPI Downloads
Dependencies
Ai2-olmo-eval has 21 dependencies, 11 of which optional.| Dependency | Optional |
|---|---|
| cached-path | false |
| datasets | false |
| importlib_resources | false |
| numpy | false |
| packaging | false |
| requests | false |
| scikit-learn | false |
| tokenizers | false |
| torch | false |
| torchmetrics | false |
| black | true |
| boto3 | true |
| build | true |
| google-cloud-storage | true |
| isort | true |
| mypy | true |
| pytest | true |
| ruff | true |
| setuptools | true |
| twine | true |
| wheel | true |