PySpect

Home

Invoices

search

top

Repository info

transformers-stream-generator

  • Summary: a summary of transformers-stream-generator
  • Description: This is a text generation method which returns a generator, streaming out each token in real-time during inference, based on Huggingface/Transformers.
  • Stars: 95
  • Number of forks: 15