AssistantServiceChat Method

public override Task Chat(
	ChatRequest request,
	IServerStreamWriter<ChatResponse> responseStream,
	ServerCallContext context
)

Public Overrides Function Chat ( 
	request As ChatRequest,
	responseStream As IServerStreamWriter(Of ChatResponse),
	context As ServerCallContext
) As Task

public:
virtual Task^ Chat(
	ChatRequest^ request, 
	IServerStreamWriter<ChatResponse^>^ responseStream, 
	ServerCallContext^ context
) override

abstract Chat : 
        request : ChatRequest * 
        responseStream : IServerStreamWriter<ChatResponse> * 
        context : ServerCallContext -> Task 
override Chat : 
        request : ChatRequest * 
        responseStream : IServerStreamWriter<ChatResponse> * 
        context : ServerCallContext -> Task 

Parameters

request  ChatRequest

LLM-Only Example: { "name": "UI", "prompt": "What is the weather today?", "history": [ { "role": "user", "content": "Hello" }, { "role": "assistant", "content": "Hi, how can I help you?" } ], "sessionId": 123, // optional but necessary for saving message and response to session history "attachedFiles": "[]" // empty list means } RAG + LLM Example: { "name": "UI", "prompt": "Who is Mercy Baker?", "attachedFiles": "[\"/path/to/file1.txt\", \"/path/to/file1.txt\"]" // Note: do not send in attached files to use ALL files in the vectordb } Special Workflows Example: { "name": "UI", "prompt": "Lead Cloud Architect at Intel", "history": [ { "role": "user", "content": "Hello" }, { "role": "assistant", "content": "Hi, how can I help you?" } ], "sessionId": 123, "promptOptions": { // send in the oneof field to specify the workflow type, and fill out all the prompt parameters it requires (if any) // In this example: The ScoreResumes workflow is selected with prompt options specified, when PromptOptions is unset it will default to generic chat "scoreResumesPrompt": { "isScoringCriteria": true } }, "attachedFiles": "[\"/path/to/resume1.pdf\", \"/path/to/resume2.pdf\"]" }

responseStream  IServerStreamWriterChatResponse

The stream to send chat responses back to the client.

context  ServerCallContext

The gRPC call context.

Return Value

Reference