AssistantServiceSetModels Method
Sets and load the models to be used by the backend.
Namespace: SuperBuilderWinService.ServicesAssembly: IntelAiaService (in IntelAiaService.exe) Version: 1.0.0+e5af843a4e6a75a047681ce8b5d33ceb3660e546
public override Task<SetModelsResponse> SetModels(
SetModelsRequest request,
ServerCallContext context
)
public:
virtual Task<SetModelsResponse^>^ SetModels(
SetModelsRequest^ request,
ServerCallContext^ context
) override
function SetModels(request, context);
- request SetModelsRequest
-
Example:
{
"llm": "C:\\ProgramData\\IntelAIA\\local_models\\Phi-3-mini-4k-instruct-hf-sym_int4",
"embedder": "C:\\ProgramData\\IntelAIA\\local_models\\bge-base-en-v1.5-hf-sym_int8",
"ranker": "C:\\ProgramData\\IntelAIA\\local_models\\bge-reranker-base-hf-sym_int8"
}
- context ServerCallContext
- The gRPC call context.
TaskSetModelsResponseExample: { "modelsLoaded": "Models are loaded." }