neural_compressor.utils.load_huggingface

Huggingface Loader: provides access to Huggingface pretrained models.

Module Contents

Classes

OptimizedModel

The class provides a method from_pretrained to access Huggingface models.

Functions

save_for_huggingface_upstream(model, tokenizer, output_dir)

Save the model and tokenizer in the output directory.

class neural_compressor.utils.load_huggingface.OptimizedModel(*args, **kwargs)[source]

The class provides a method from_pretrained to access Huggingface models.

neural_compressor.utils.load_huggingface.save_for_huggingface_upstream(model, tokenizer, output_dir)[source]

Save the model and tokenizer in the output directory.