`neural_compressor.compression.distillation.optimizers`

Intel Neural Compressor built-in Optimizers on multiple framework backends.

Module Contents

`TensorflowOptimizers`	Class to get all registered TensorFlow Optimizers once only.
`PyTorchOptimizers`	Class to get all registered PyTorch Optimizers once only.
`Optimizers`	Main entry to get the specific type of optimizer.
`TensorFlowSGD`	TensorFlow keras SGD optimizer.
`TensorFlowAdamW`	tensorflow_addons AdamW optimizer.
`TensorFlowAdam`	Tensorflow Adam optimizer.
`PyTorchSGD`	PyTorch SGD optimizer.

optimizer_registry(optimizer_type, framework)

Class decorator used to register all Optimizer subclasses.

class neural_compressor.compression.distillation.optimizers.TensorflowOptimizers[source]: Class to get all registered TensorFlow Optimizers once only.

class neural_compressor.compression.distillation.optimizers.PyTorchOptimizers[source]: Class to get all registered PyTorch Optimizers once only.

class neural_compressor.compression.distillation.optimizers.Optimizers(framework)[source]: Main entry to get the specific type of optimizer.

neural_compressor.compression.distillation.optimizers.optimizer_registry(optimizer_type, framework)[source]

Class decorator used to register all Optimizer subclasses.

Cross framework optimizer is supported by add param as framework=’tensorflow, pytorch’

Parameters:

Returns:

The class of register.

Return type:

cls

class neural_compressor.compression.distillation.optimizers.TensorFlowSGD(param_dict)[source]

TensorFlow keras SGD optimizer.

Parameters:: param_dict (dict) – The dict of parameters setting by user for SGD optimizer

class neural_compressor.compression.distillation.optimizers.TensorFlowAdamW(param_dict)[source]

tensorflow_addons AdamW optimizer.

Parameters:: param_dict (dict) – The dict of parameters setting by user for AdamW optimizer

class neural_compressor.compression.distillation.optimizers.TensorFlowAdam(param_dict)[source]

Tensorflow Adam optimizer.

Parameters:: param_dict (dict) – The dict of parameters setting by user for Adam optimizer

class neural_compressor.compression.distillation.optimizers.PyTorchSGD(param_dict)[source]

PyTorch SGD optimizer.

Parameters:: param_dict (dict) – The dict of parameters setting by user for SGD optimizer