`fastchat.serve.serve_chatglm`

Module Contents

Functions

chatglm_generate_stream(model, tokenizer, params, device)

Generate text using model's chat api

fastchat.serve.serve_chatglm.chatglm_generate_stream(model, tokenizer, params, device, context_len=2048, stream_interval=2)[source]: Generate text using model’s chat api