© 2025-2026 PySpect
| Dependency | Optional | Group |
|---|---|---|
| fastwarc | false | |
| apache-beam | true | beam |
| beautifulsoup4 | true | cli-benchmark |
| boto3 | true | beam |
| Package | Optional | Group |
|---|---|---|
| resiliparse | true | all |
| trafilatura | true | eval |
| click | true | cli |
| elasticsearch | true | beam |
| joblib | true | cli |
| langid | true | cli-benchmark |
| pytest | true | test |
| pytest-cov | true | test |
| resiliparse | true | all |
| selectolax | true | cli-benchmark |
| tqdm | true | cli |