`fastchat.serve.api`

This module provides a ChatGPT-compatible Restful API for chat completion.

Usage:

python3 -m fastchat.serve.api

Reference: https://platform.openai.com/docs/api-reference/chat/create

Module Contents

Functions

create_chat_completion(request)

Creates a completion for the chat message

async fastchat.serve.api.create_chat_completion(request: fastchat.protocol.chat_completion.ChatCompletionRequest)[source]: Creates a completion for the chat message