PySpect

Home

lists

Frequently asked questions

© 2025 PySpect

Repository info

transformers-stream-generator

  • Summary: a summary of transformers-stream-generator
  • Description: This is a text generation method which returns a generator, streaming out each token in real-time during inference, based on Huggingface/Transformers.
  • Stars: 95
  • Number of forks: 16