neural_compressor.torch.utils.auto_accelerator

Module Contents

Classes

Auto_Accelerator	Helper class that provides a standard way to create an ABC using
CPU_Accelerator	Helper class that provides a standard way to create an ABC using
CUDA_Accelerator	Helper class that provides a standard way to create an ABC using
XPU_Accelerator	Helper class that provides a standard way to create an ABC using
HPU_Accelerator	Helper class that provides a standard way to create an ABC using

Functions

register_accelerator(→ Callable[Ellipsis, Any])

Register new accelerator.

neural_compressor.torch.utils.auto_accelerator.register_accelerator(name: str, priority: float = 0) → Callable[Ellipsis, Any]

Register new accelerator.

Usage example:

@register_accelerator(name=”cuda”, priority=100) class CUDA_Accelerator:

…

Parameters:

• name – the accelerator name.

• priority – the priority of the accelerator. A larger number indicates a higher priority,

class neural_compressor.torch.utils.auto_accelerator.Auto_Accelerator

Helper class that provides a standard way to create an ABC using inheritance.

class neural_compressor.torch.utils.auto_accelerator.CPU_Accelerator

Helper class that provides a standard way to create an ABC using inheritance.

class neural_compressor.torch.utils.auto_accelerator.CUDA_Accelerator

Helper class that provides a standard way to create an ABC using inheritance.

class neural_compressor.torch.utils.auto_accelerator.XPU_Accelerator

Helper class that provides a standard way to create an ABC using inheritance.

class neural_compressor.torch.utils.auto_accelerator.HPU_Accelerator

Helper class that provides a standard way to create an ABC using inheritance.