Summary: SMASHED is a toolkit designed to apply transformations to samples in datasets, such as fields extraction, tokenization, prompting, batching, and more. Supports datasets from Huggingface, torchdata iterables, or simple lists of dictionaries.
Author: Allen Institute for Artificial Intelligence <contact@allenai.org>, Luca Soldaini <luca@soldaini.net>, Kyle Lo <kylel@allenai.org>
Weekly downloads over the last yearSeptemberOctoberNovemberDecember2026FebruaryMarchAprilMayJuneJulyAugustDate00.511.522.533.54 thousand downloads per week