Package profile
smashed
- Summary: SMASHED is a toolkit designed to apply transformations to samples in datasets, such as fields extraction, tokenization, prompting, batching, and more. Supports datasets from Huggingface, torchdata iterables, or simple lists of dictionaries.
- Author: Allen Institute for Artificial Intelligence <contact@allenai.org>, Luca Soldaini <luca@soldaini.net>, Kyle Lo <kylel@allenai.org>
- License: Apache Software License
- Homepage: https://github.com/allenai/smashed
- Source: https://github.com/allenai/smashed
- Number of releases: 64
- First release: 0.1.0 on 2022-07-25
- Latest release: 0.21.5 on 2023-09-22
- Latest release size: 93.2 KB (pure Python wheel)