neural_compressor.compression.pruner.patterns.mha

MHA patterns.

Classes

PatternMHA

Pruning Pattern.

Module Contents

class neural_compressor.compression.pruner.patterns.mha.PatternMHA(config, modules=None)

Pruning Pattern.

A Pattern class derived from BasePattern. In this pattern, we calculate head masks for a MHA module For more info of this pattern, please refer to : https://github.com/intel/neural-compressor/blob/master/docs/sparsity.md

Parameters:

config – A config dict object that contains the pattern information.

N

The number of elements to be pruned in a weight sequence.

M

The size of the weight sequence.