neural_compressor.compression.distillation.optimizers

Intel Neural Compressor built-in Optimizers on multiple framework backends.

Classes

TensorflowOptimizers	Class to get all registered TensorFlow Optimizers once only.
PyTorchOptimizers	Class to get all registered PyTorch Optimizers once only.
Optimizers	Main entry to get the specific type of optimizer.
TensorFlowSGD	TensorFlow keras SGD optimizer.
TensorFlowAdamW	tensorflow_addons AdamW optimizer.
TensorFlowAdam	Tensorflow Adam optimizer.
PyTorchSGD	PyTorch SGD optimizer.

Functions

optimizer_registry(optimizer_type, framework)

Class decorator used to register all Optimizer subclasses.

Module Contents

class neural_compressor.compression.distillation.optimizers.TensorflowOptimizers

Class to get all registered TensorFlow Optimizers once only.

class neural_compressor.compression.distillation.optimizers.PyTorchOptimizers

Class to get all registered PyTorch Optimizers once only.

class neural_compressor.compression.distillation.optimizers.Optimizers(framework)

Main entry to get the specific type of optimizer.

neural_compressor.compression.distillation.optimizers.optimizer_registry(optimizer_type, framework)

Class decorator used to register all Optimizer subclasses.

Cross framework optimizer is supported by add param as framework=’tensorflow, pytorch’

Parameters:

• optimizer_type (str) – The string of supported criterion.

• framework (str) – The string of supported framework.

Returns:

The class of register.

Return type:

cls

class neural_compressor.compression.distillation.optimizers.TensorFlowSGD(param_dict)

TensorFlow keras SGD optimizer.

Parameters:

param_dict (dict) – The dict of parameters setting by user for SGD optimizer

class neural_compressor.compression.distillation.optimizers.TensorFlowAdamW(param_dict)

tensorflow_addons AdamW optimizer.

Parameters:

param_dict (dict) – The dict of parameters setting by user for AdamW optimizer

class neural_compressor.compression.distillation.optimizers.TensorFlowAdam(param_dict)

Tensorflow Adam optimizer.

Parameters:

param_dict (dict) – The dict of parameters setting by user for Adam optimizer

class neural_compressor.compression.distillation.optimizers.PyTorchSGD(param_dict)

PyTorch SGD optimizer.

Parameters:

param_dict (dict) – The dict of parameters setting by user for SGD optimizer