Package profile
transformers-stream-generator
- Summary: This is a text generation method which returns a generator, streaming out each token in real-time during inference, based on Huggingface/Transformers.
- Author: LowinLi
- Homepage: https://github.com/LowinLi/transformers-stream-generator
- Source: https://github.com/LowinLi/transformers-stream-generator (Repo profile)
- Number of releases: 5
- First release: 0.0.1 on 2023-03-26
- Latest release: 0.0.5 on 2024-03-11