simcop2387/text-generation-webui-mirror
1
0
Fork 0
mirror of https://github.com/oobabooga/text-generation-webui.git synced 2025-06-08 22:56:24 -04:00
Code Issues Projects Releases Packages Wiki Activity

fix websocket batching (#1511)

Browse source
This commit is contained in:
MajdajkD 2023-04-24 08:51:32 +02:00 • committed by GitHub
parent 78d1977ebf
commit c86e9a3372
No known key found for this signature in database
GPG key ID: 4AEE18F83AFDEB23
1 changed files with 2 additions and 0 deletions
Show stats Download patch file Download diff file Expand all files Collapse all files

2
extensions/api/streaming_api.py
View file

@ -44,6 +44,8 @@ async def _handle_connection(websocket, path):
'text': to_send
}))
await asyncio.sleep(0)
skip_index += len(to_send)
message_num += 1