`neural_compressor.experimental.distillation`

Distillation class.

Module Contents

Classes

Distillation class derived from Component class.

class neural_compressor.experimental.distillation.Distillation(conf_fname_or_obj=None)[source]

Distillation class derived from Component class.

Distillation class abstracted the pipeline of knowledge distillation, transfer the knowledge of the teacher model to the student model.

Parameters:: conf_fname_or_obj (string or obj) – The path to the YAML configuration file or Distillation_Conf containing accuracy goal, distillation objective and related dataloaders etc.

_epoch_ran[source]: A integer indicating how much epochs ran.

eval_frequency[source]: The frequency for doing evaluation of the student model in terms of epoch.

best_score[source]: The best metric of the student model in the training.

best_model[source]: The best student model found in the training.