Add stream output support
#21
by
JamePeng2023
- opened
This comment has been hidden
Add streaming support for text generation
- Implemented streaming functionality for real-time text output.
- Added
_decode_streammethod to handle text streaming. - Updated
chatmethod to support streaming mode. - Adjusted code to process and yield text in chunks for better responsiveness.
This update enhances the user experience by allowing incremental text generation and display.
JamePeng2023
changed pull request status to
open