AssistantServiceSetModels Method
Sets and load the models to be used by the backend.
Namespace: SuperBuilderWinService.ServicesAssembly: IntelAiaService (in IntelAiaService.exe) Version: 1.0.0+2093811f3bac5da092b5ce9c8172233582eee4d5
public override Task<SetModelsResponse> SetModels(
SetModelsRequest request,
ServerCallContext context
)
Public Overrides Function SetModels (
request As SetModelsRequest,
context As ServerCallContext
) As Task(Of SetModelsResponse)
public:
virtual Task<SetModelsResponse^>^ SetModels(
SetModelsRequest^ request,
ServerCallContext^ context
) override
abstract SetModels :
request : SetModelsRequest *
context : ServerCallContext -> Task<SetModelsResponse>
override SetModels :
request : SetModelsRequest *
context : ServerCallContext -> Task<SetModelsResponse>
- request SetModelsRequest
-
Example:
{
"llm": "C:\\ProgramData\\IntelAIA\\local_models\\Phi-3-mini-4k-instruct-hf-sym_int4",
"embedder": "C:\\ProgramData\\IntelAIA\\local_models\\bge-base-en-v1.5-hf-sym_int8",
"ranker": "C:\\ProgramData\\IntelAIA\\local_models\\bge-reranker-base-hf-sym_int8"
}
- context ServerCallContext
- The gRPC call context.
TaskSetModelsResponseExample: { "modelsLoaded": "Models are loaded." }