Package search
transformers-stream-generator
- Summary: This is a text generation method which returns a generator, streaming out each token in real-time during inference, based on Huggingface/Transformers.
- Author: LowinLi
- Homepage: https://github.com/LowinLi/transformers-stream-generator
- Source: https://github.com/LowinLi/transformers-stream-generator
- Repo profile
- Number of releases: 5
- First release: 0.0.1 on 2023-03-26T08:43:29
- Latest release: 0.0.5 on 2024-03-11T14:18:02
| Dependency | Optional |
|---|